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FOREWORD 

Any  living  person  whose  commercial  experience  reaches  back 
as  far  as  forty  or  fifty  years  must  be  impressed  with  the  phe- 
nomenon of  industrial  progress.  He  must  remember  with  some 
clarity  the  tentative  and  timorous  introduction  and  the  indif- 
ferent and  skeptical  reception  of  mechanical  achievements 
which  have  since  grown  indispensable  to  our  social  and  personal 
well-being. 

There  is  no  precedent  in  history  for  so  rapid  a  transition  from 
a  phase  of  novelty  to  that  of  indispensability  which  involved, 
simultaneously,  so  many  epoch-making  innovations.  The  more 
generally  familiar  examples  are,  of  course,  the  telephone  and 
telegraph,  the  automobile,  motion  pictures,  the  airplane,  radio 
and,  just  beginning,  television.  But,  with  little  acclaim  or  even 
public  knowledge,  lesser  innovations  have  been  and  are  being 
daily  introduced  into  practically  every  known  industry  to  the 
betterment  of  its  product  and  of  its  service  to  society. 

Side  by  side  with  this  development  of  new  products  and  the 
improvement  of  existing  ones  there  has  been  a  similar  advance- 
ment in  methods  of  production.  This  is  still  in  progress.  Proba- 
bly none  of  these  conveniences,  now  commonplace  among  us, 
could  have  reached  its  present  position  without  the  theory  of 
manufacture  so  significantly  called  "mass  production." 

Any  effort  to  explain  mass  production  and  the  concurrent 
acceleration  of  progress  in  the  past  half  century,  as  represented 
by  new  and  better  and  more  production,  must  find  some  catalytic 
agency  which  cannot  be  identified  with  any  previous  period. 
Something  certainly  happened;  some  new  element  must  surely 
have  been  sprinkled  over  the  quietly  simmering  caldron  of 
production  to  make  it  seethe  so  suddenly  and  so  resultfully. 

It  could  not  have  been  the  invention  of  any  new  device.  The 
more  important  inventions — the  power  loom  (1785),  the  cotton 
gin  (1790),  the  reaper  (1834),  the  sewing  machine  (1846)— long 
preceded  the  current  industrial  renaissance  but,  outside  of  their 
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own  respective  and  immediate  fields,  they  caused  scarcely  a 
flutter  in  the  production  tempo  of  their  time. 

In  the  industrial  twilight  that  followed  our  Civil  War  all 
progress  must  have  seemed  to  rest  upon  the  meager  results  of 
personal  genius.  Those  were  the  days  of  the  individual  inventor ; 
the  producer  of  " gadgets."  But  nothing  can  be  found  in  that 
period  to  account  for  our  present  nationwide  productive  effi- 
ciency.    The  explanation  must  lie  elsewhere. 

It  is  probable  that  the  explanation,  the  catalytic  agent,  is 
embodied  in  no  identifiable  place  or  person  or  class  of  persons 
nor  wholly  in  any  economic  circumstance  or  event.  It  seems 
rather  to  involve  a  spirit,  a  philosophy,  which  began  to  make 
itself  felt  during  the  closing  years  of  the  past  century  and  has 
now  come  to  flower  in  our  previously  undreamed-of  productive 
resources. 

It  is  the  spirit  of  inquiry.  It  is  what  Buckle1  meant  when  he 
ascribed  all  progress  to  the  discontent  "of  the  skeptic,  to  his 
refusal  to  believe  that  things  as  they  are  cannot  be  improved 
and  to  his  determined  and  ceaseless  effort  to  demonstrate  the 
advantage  of  change.  Neither  Buckle  nor  his  philosophy  had 
anything  to  do  with  the  industrial  progress  in  America.  Here 
the  spirit  he  referred  to  was  the  legitimate  child  of  necessity. 
Change  was  forced  upon  us.  The  country  was  comparatively 
new.  It  was  repairing  the  ravages  of  a  war.  It  was  growing 
rapidly  in  population  and  social  exigency.  Its  needs  were  increas- 
ing in  both  variety  and  volume.  Gradually  the  more  skeptical, 
the  more  searching,  the  more  scientifically  inclined  among 
producers  began  to  feel  themselves  circumscribed  by  their 
equipment  and  processes.  Change  had  to  come,  not  alone  in  the 
machinery  of  production  but  in  its  management  as  well.  ^ 

Men  began  to  study  production.  They  engaged  specialists  to 
study.  They  enlisted  the  aid  of  institutions.  Factory  opera- 
tions were  broken  down  and  each  component  subjected  to  analy- 
sis—as to  motion  and  time  and  cost.  Laboratories  all  over  the 
land  were  set  to  work,  revising  old  processes  and  originating  new 
ones  in  chemistry,  physics  and  related  industrial  sciences. 
Empirical  standards  of  performance  were  arrived  at  for  indi- 
viduals, for  groups,  for  mechanical  units.  A  profession  of 
»  Buckle,  Henry  Thomas  (1821-1862),  The  History  of  Civilisation  in 
England. 
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efficiency  engineers  sprang  up,  with  Frederick  Winslow  Taylor1 
as  its  dean,  to  foster  and  build  this  awakening  spirit  of  inquiry 
into  the  philosophy  of  mass  production.  This  was  production 
research  expressing  itself  in  action. 

What  this  philosophy  of  scientific  research  in  production  has 
meant  to  the  present  generation— in  health,  efficiency,  knowledge, 
pleasure,  culture,  convenience,  comfort,  domestic  economy— is 
being  daily  demonstrated  in  the  life  of  every  individual  who  can 
avail  himself  of  its  advantages.  In  the  broader  aspect  of  our 
national  economy,  however,  it  has  meant  something  more  than 
the  aggregate  of  individual  benefits;  it  has  forced  our  producing 
capacity  so  far.  ahead  of  our  facilities  for  distribution  as  to  have 
thrown  our  national  economy,  temporarily  at  least,  out  of  balance. 

It  has  brought  about  a  situation  in  which,  as  a  nation,  we 
resemble  a  huge  manufacturing  plant;  amply  capitalized, 
expertly  organized,  aggressively  managed,  fully  stocked  with 
raw  material,  equipped  with  the  most  modern  and  productive 
machinery;  but,  because  we  lack  the  facilities  and  the  skill  to 
move  the  finished  product,  promptly  from  the  shipping  room,  we 
are  running  under  banked  fires  with  a  skeleton  crew. 

We  can  content  ourselves  with  this  situation;  we  can  suffer  it 
until  some  cataclysm  jolts  us  out  of  our  lethargy,  as  almost 
happened  in  1929,  or  we  can  "take  arms  against  a  sea  of  troubles, 
and  by  opposing  end  them."  There  are  many  weapons  and  many 
points  of  attack.     The  field  is  distribution  and  the  enemy  is 

waste. 

It  is  significant  that  the  only  difference  between  this  situation 
and  that  which  formerly  confronted  production  lies  in  the  field 
affected.  It  was  production;  it  is  distribution.  Under  com- 
pulsion of  a  half-idle  production  plant  we  are  now  being  forced 
to  rectify  the  disparity  between  our  vast  capacity  to  produce 
and  our  underdeveloped  capacity  to  distribute;  and  there  is  no 
better  method  than  that  which  was  so  successfully  utilized  iri 
production. 

The  need  for  this  activity  is  not  new.  It  has  not  sprung  out 
at  us,  suddenly,  from  under  the  dark  cloak  of  the  depression. 
Many  years  ago,  when  the  results  of  research  became  manifest 
in  production,  precocious  individuals  began  to  realize  that,  if 

i  Taylor,  Frederick  Winslow  (1856-1915),  American  efficiency 
engineer,  pioneer  of  scientific  management  in  production. 
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distribution  were  to  keep  the  pace,  the  same  analytical,  scientific 
process  of  study  must  be  applied  to  marketing.  After  the 
World  War,  with  our  production  plant  artifically  expanded 
beyond  all  previous  records,  the  need  for  an  improved  distribut- 
ing system  became  more  manifest  and  here  and  there  manu- 
facturers, agencies  and  individuals  began  resolutely  to  attack 
the  problem. 

But  it  was  not  easy,  then,  either  to  do  research  work  in  market- 
ing or  to  induce  others  to  undertake  it.  It  presented  a  much 
more  subtle  field  than  the  physical  materials,  the  mechanical 
forces  and  the  repetitive  human  movements  which  constituted 
the  major  subjects  of  study  in  production  research.  So  much 
that  is  significant  in  marketing  research  must  be  drawn  from 
reactions  almost  wholly  psychological;  it  involves  usually  an 
intricate  compound  of  quantitative  and  qualitative  data;  and, 
however  suitable  to  mathematical  treatment  the  data  may  be, 
their  practical  implications  must  rest  ultimately  upon  the 
personal  experience,  the  vision  and  the  innate  wisdom  of  the 
interpreter. 

Because  of  these  inherent  difficulties  and  because  no  clearly 
defined  method  had  yet  been  evolved  for  the  assembly  and  study 
of  such  diffused  and  indeterminate  data — but,  more  particularly, 
because  " business"  had  not  yet  accepted  marketing  research 
as  a  concomitant  of  successful  operation — the  collapse  of  1929- 
1930  caught  the  country  at  a  grave  disadvantage. 

There  is  no  thought  here  that  marketing  research  alone  could 
have  averted  the  collapse,  any  more  than  production  research 
could  have  prevented  the  depressions  of  1907  and  1921.  There 
are  too  many  diverse  factors  affecting  these  major  economic 
movements.  But  this  much  can  be  said :  Had  research  progressed 
as  far  in  marketing  as  it  had  in  production,  much  of  the  distress 
of  this  latest  depression  would  have  been  forestalled  and  much 
more  of  it  assuaged.  The  redirection  of  resources  long  wasted 
in  distribution  would  unquestionably  have  saved  some  businesses, 
as  well  as  banks,  from  extinction. 

It  is  true  that  prior  to  1929  some  few  of  the  more  enlightened 
industrialists  and  merchants  were  experimenting  with  research 
in  their  marketing  operations.  But  it  is  only  during  the  ensuing 
difficult  years  that  the  marketing  research  thesis  has  approached 
anything  like  a  broad  acceptance — and  still  only  among  the 
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intellectual  elite  of  business.  It  is  being  made  clear  now,  how- 
ever, that  marketing  research  must  grow  speedily,  and  grow 
considerably,  in  both  acceptance  and  use  if  it  is  fully  to  achieve 
its  aim  in  distribution. 

That  aim  is  to  effect  the  "  transfer  and  sale  of  goods  and 
services"  with  greater  celerity,  over  a  broadened  field  and  at 
lower  cost.  That  is  to  say:  To  keep  pace  with  our  present-day 
production  plant,  some  means  must  be  found  to  keep  the  stream 
of  goods  and  services  flowing  from  producer  to  consumer  more 
freely,  more  smoothly  and  more  profitably;  to  raise  the  per  capita 
consumption  of  present  users  of  goods  and  services;  to  bring  the 
output  of  production  within  reach  of  new  and  greatly  enlarged 
fields  of  consumers  and  to  eliminate  every  form  of  waste  that  now 
inflates  the  cost  of  distribution. 

Having  witnessed  the  extraordinary  effect  of  study  on  our 
once  sluggish  production  system,  we  can  proceed  with  confidence 
to  apply  the  same  proven  solvent  to  these  other  problems  now 
pressing  for  solution  in  marketing.  This  development  is  on  its 
way.  It  can  be  speeded  and  its  benefits  made  secure  and  lasting 
by  a  consistent  adherence  to  an  approved  technique.  It  is  to 
lay  the  groundwork  for  such  a  technique  that  this  treatise  has 
been  written. 

This  book,  therefore,  represents  the  fulfillment  of  a  responsi- 
bility undertaken  by  the  American  Marketing  Society's  Com- 
mittee on  Marketing  Research  Technique.  It  is  the  result  of 
work  seriously  begun  by  that  committee  in  January,  1932,  and 
carried  forward  to  this  culmination  in  spite  of  frequent  unavoid- 
able interruptions  and  many  inherent  obstacles. 

The  first  achievement  of  this  committee  took  the  form  of  a 
series  of  charts  illustrating  the  various  stages  of  marketing/ 
research  procedure  and  these  were  published  as  a  partial  report 
of  the  committee  in  the  April,  1934,  issue  of  the  American 
Marketing  Journal1  With  some  minor  alterations  these  are  the 
functional  charts  which  are  shown  in  their  appropriate  stages 
throughout  the  finished  work. 

The  development  of  these  charts  into  a  practical  textbook  on 

marketing   research    procedure   was   part    of    the    committee's 

original  plan.     The  " Statement  of  Committee  Purpose"  which 

i  Later  merged  with  The  National  Marketing  Review  to  form  The  Journal  of 

Marketing— -the  quarterly  publication  of  the  American  Marketing  Association. 


x  FOREWORD 

appears  in  the  text  in  Chart  A  was  set  forth  in  identical  language 
in  the  very  first  draft  submitted  to  the  Society  by  the  committee 
—as  early  as  February,  1932. 

In  building  this  treatise  each  member  of  the  committee 
volunteered  to  elaborate  one  stage  of  the  procedure.  These 
various  contributions,  aggregating  a  formidable  mass  of  material, 
were  then  integrated  into  its  finished  form  by  the  editorial 
subcommittee. 

As  the  volume  neared  completion  copies  of  the  manuscript 
were  placed  in  the  hands  of  several  members  and  friends  of  the 
Society  who  generously  offered  to  give  the  whole  treatise  a 
critical  reading.  These  cooperators,  who  fulfilled  their  gratui- 
tous office  as  conscientiously  and  as  thoroughly  as  the  committee 
itself,  were: 
Dr.    Paul   Felix  Lazarsfeld— University   of   Newark,    Research 

Center,  Newark,  New  Jersey. 
Nelson  H.  Seubert— research  director,  Media  Records,  New  York 

City. 
Frederick   P.    Valentine— formerly    assistant    vice-president    of 
American  Telephone  and  Telegraph  Company,  Noroton,  Conn. 

On  behalf  of  the  committee,  the  Society  takes  this  occasion 
sincerely  to  thank  these  gentlemen  for  their  substantial  and 
constructive  assistance. 

The  Society  also  takes  this  opportunity  to  thank  Dr.  Lazarsfeld 
for  his  several  elaborate  and  painstaking  discourses  on  the 
psychological  aspects  of  marketing  research  work.  Special 
thanks,  too,  are  due  to  Alfred  T.  Falk  who,  besides  his  work  as  a 
member  of  the  committee,  contributed  the  condensed  but 
instructive  discussion  on  statistical  procedure  in  marketing 
research  which  appears  in  this  treatise  as  Chapter  XIX. 

The  Society's  thanks  are  likewise  accorded  to  both  the  Inter- 
national Business  Machines  Corporation  and  the  Recording  and 
Statistical  Corporation  for  the  material  they  supplied  in  con- 
nection with  mechanical  tabulation  which  is  embodied  in  Chapter 

XIV. 

To  all  the  other  members  and  nonmembers  of  the  Society 
whose  sympathetic  interest  and  cooperation  have  added  to  the 
accomplishment  of  this  work  the  Society  extends  its  thanks  in 
equal  measure. 
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Finally,  the  Society  takes  particular  pleasure  in  commending 
the  long-sustained  interest  of  the  members  of  the  committee, 
their  unstinted  contribution  of  time,  thought  and  effort  to  the 
rather  large  task  each  of  them  assumed  and  to  thank  them  all 
for  the  unselfish  and  congenial  spirit  which  characterized  their 
application  to  this  work. 

'  The  Directors  of  the  American  Marketing  Society  recognize 
this  work  as  a  distinctive  contribution  to  the  science  of  market- 
ing. It  outlines  the  procedure  of  modern  marketing  research 
practice  thoroughly  and  with  a  fine  simplicity. 

The  committee  which  prepared  this  work  and  its  advisors 
comprise  leading  authorities  in  the  general  and  specialized  fields 
of  marketing  research.  The  method  set  forth  reflects  the 
accepted  standards  of  professional  practice  and  the  society  is 
giving  practical  expression  to  its  high  regard  for  the  work  by 
authorizing  its  publication  under  its  official  sponsorship.  _ 

To  Ferdinand  C.  Wheeler,  chairman  of  the  committee,  is  due 
the  highest  honor.  Without  his  skill,  patience  and  devotion  in 
organizing,  coordinating,  collaborating,  compiling  and  rewriting, 
so  complete  and  comprehensive  a  work  would  perhaps  never 
have  been  possible.  The  Society  hopes  that  many  thousands  ot 
students,  business  and  professional  men  will  benefit  by  what  he 

has  done.  . 

Frank  R.  Coutant 

President 
American  Marketing  Society 

New  York  City, 
November,  1936. 
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INTRODUCTION 

(As  Presented  in  Charts  A  and  B) 

Marketing  research  has  been  authoritatively  denned  as  "the 
study  of  all  problems  relating  to  the  transfer  and  sale  of  goods 
and  services  from  producer  to  consumer  .  .  .  "*  This  definition, 
like  most  others,  may  be  illuminated  by  a  closer  examination  of 
its  several  distinguishable  features.  First  of  all  and  essentially 
it  is  "study."  It  is,  therefore,  specifically  differentiated  from 
any  casual,  cursory  or  superficial  inquiry.  It  is  a  planned, 
orderly,  thorough  and  analytical  consideration  of  every  discover- 
able factor  which  might  by  any  possibility  affect  the  point  or 
situation  at  issue. 

It  is  this  concept  of  study  as  the  essence  of  marketing  research 
that  calls  for  a  formulated  technique,  some  well  defined  method- 
ology, as  a  means  of  reaching  conclusions  of  uniform  reliability. 
But  it  must  be  a  flexible  technique,  and  it  must  deal  with  prin- 
ciples; because,  according  to  the  definition,  it  must  be  applicable 
to  "all  problems"  involved  in  the  marketing  process. 

Scope  of  Marketing  Research 

"The  transfer  and  sale  of  goods  and  services  from  producer  to 
consumer"  constitutes  the  field  in  which  marketing  problems 
must  lie.  That,  too,  is  the  field  in  which  the  appropriate  research 
must  function. 

Some  of  this  research  is  of  a  general  character,  having  to  do 
with  marketing  in  its  broader  economic  or  social  sense.  The 
following  are  some  examples  of  researches  of  this  type: 

Markets  and  Quotas,  Curtis  Publishing  Company,  1932. 

Market  Guide  for  1936,  Editor  and  Publisher. 

Study  of  All  American  Markets  (100,000  Group  of  American  Cities),  4th  ed., 

Major  Market  Newspapers,  Inc. 
Basis  of  Sales  Quotas,  A  Supplement  to  the  Trading  Area  System  of  Sales 

Control,  International  Magazine  Company,  Inc.,  1935. 

1  "Consolidated  Report  of  the  Committee  on  Definitions,"  The  National 
Marketing  Review,  publication  of  the  National  Association  of  Marketing 
Teachers,  Vol.  1,  p.  157,  Fall,  1935. 
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"Survey  of  Spending  Power,"  Sales  Management,  April  10,  1935. 
Population  and  Its  Distribution,  5th  ed.,  J.  Walter  Thompson  Company, 

1931. 
Distribution  Census,  U.  S.  Census  Bureau,  Vol.  I,  Retail,  3  parts;  Vol.  II, 

Wholesale. 
Census  of  American  Business,  U.  S.  Census  Bureau, 

"Retail  Distribution,"  8  vols.,  paper. 

"Wholesale  Distribution,"  8  vols.,  paper. 

"Services,  Amusements  and  Hotels,"  4  vols.,  paper. 
Consumer  Use  of  Selected  Goods  and  Services  by  Income  Classes,  U.  S.  Bureau 

of  Foreign  and  Domestic  Commerce  (8  cities  to  date),  1935. 
Real  Property  Inventory,  U.  S.  Bureau  of  Foreign  and  Domestic  Commerce 

(64  cities),  1935. 

These  are  imposing  studies.  They  all  serve  a  real  and  con- 
structive purpose.  They  touch  many  subjects,  are  applicable 
to  many  problems,  provide  a  fund  of  material  collated  for  ready 
use,  are  available  to  everyone  and  are  making  a  distinct  contri- 
bution to  the  literature  of  marketing  research.  These  are  the 
general  studies. 

The  great  majority  of  marketing  studies,  however,  are  specific 
to  individual  businesses.  Thousands  of  specific  business  prob- 
lems are  arising  daily;  some  of  them  are  large,  some  small,  but 
all  are  of  high  consequence  to  the  business  involved.  However 
varied  these  problems  may  be  in  their  individual  aspects,  they 
fall  quite  obviously  into  a  few  clearly  marked  categories  and 
these  may  be  identified  by  their  respective  positions  in  the 
sequence  of  operation. 

For  example:  Long  before  a  product  is  ready  for  transfer  or 
sale,  some  policies  must  be  considered.  These  primary  policies 
may  have  to  do  with  finance— as,  what  amount  of  capital  shall 
be  provided  for  promoting  the  sale  of  the  proposed  product  ?  Or 
they  may  have  to  do  with  the  form  in  which  the  product  is  to  be 
offered— as,  shall  the  prospective  product  be  sold  in  bulk  or  in 
packages?  Or  they  may  relate  to  raw  material— as,  would  this 
proposed  device  have  a  better  sales  opportunity  if  made  of 
metal,  wood,  rubber  or  composition?  Or  they  may  concern  the 
method  of  selling— as,  shall  this  product  be  sold  outright  or 
licensed  and  shall  it  be  sold  for  prompt  payment  or  on 
installments? 

Decisions  must  be  made  on  all  such  points.     Policies  must  be 
adopted.     For  the  maximum  efficiency  in  the  conduct  of  the 
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business,  and  even  for  its  safety,  those  policies  must  be  predicated 
upon  actualities,  facts,  determinable  only  through  competent 
research.  And  since  those  are  the  earliest  questions  to  be 
encountered,  they  constitute  the  first  of  the  several  types  of 
problems  to  which  marketing  research  may  profitably  be  applied. 

It  must  be  realized,  however,  that  problems  of  this  sort  arise 
after  production  as  well  as  before.  They  are  just  as  truly 
problems  of  policy  but,  at  this  latter  juncture,  they  relate  usually 
to  the  current  phases  of  management — personnel  selection,  train- 
ing and  control,  credit  policies,  marketing  strategy,  the  degree 
and  mobility  of  sales  pressure.  All  such  questions  belong  in  the 
the  category  of  "studies  relating  to  policy"  listed  first  on  the 
accompanying  chart. 

The  next  stage  in  the  sequence  of  operation  naturally  has  to  do 
with  "the  product."  This  is  the  second  category.  Every 
question  that  might  arise  to  affect  the  salability  of  the  product, 
as  it  is  presented  to  the  market,  falls  within  this  class  or  type. 
Generally  speaking,  these  questions  have  to  do  with  quality, 
style,  size,  price,  color,  brand  name  and  other  such  intrinsic 
features  of  the  product  considered  alone  and  also  in  its  relation 
to  other  products  in  competition  with  it. 

r#  Following  the  product,  the  next  natural  consideration  is  the 
field — the  country,  state,  county,  city — in  which  it  is  to  be  offered 
for  sale.  This  field  and  its  people  constitute  the  "market." 
Questions  in  this  class  usually  have  to  do  with  the  accessibility 
of  the  field  for  sales  work,  service  and  profits;  the  type  and 
character  of  the  people,  the  possible  consumers,  their  ability  and 
disposition  to  buy;  the  number,  type  and  other  characteristics 
of  the  dealers  and  other  distributors  and,  of  course,  the  sales, 
advertising  and  service  activities  of  all  competitors.  Questions 
of  this  description  belong  logically  in  the  third  category. 

Finally,  with  marketing  policies  determined,  the  product 
ready  for  its  market  and  the  market  itself  surveyed,  there  remains 
to  be  considered  the  "methods  and  means"  by  which  the  "trans- 
fer and  sale"  of  the  product  are  to  be  accomplished.  This  is  the 
fourth  category,  and  it  includes  all  questions  of  sales  promotion, 
advertising  and  selling,  questions  concerning  the  company's 
approach  to  the  various  channels  of  distribution,  the  extent  and 
kind  of  services  required  by  competitive  conditions  and  all  other 
cognate  matters. 
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A  more  detailed  discussion  of  the  questions  falling  within  these 
classes  will  be  given  later  in  connection  with  the  Analysis  of  the 
Problem.  It  will  be  found  that  practically  every  normal 
marketing  problem,  either  general  or  specific,  can  be  related  to 
one  or  more  of  these  categories.  And,  notwithstanding  their 
manifold  differences,  all  of  them  are,  in  principle,  amenable  to 
one  uniform  research  procedure. 

This  statement  is  not  so  remarkable  as  it  may  at  first  seem. 
The  essence  of  research  has  been  identified  as  study.  The 
uniform  procedure  is  a  method  of  study.  It  is  a  routine,  a  systema- 
tized plan,  and  it  has  all  the  flexibility  required  for  the  study  of 
any  situation  or  issue  that  might  arise. 

This  is  the  method,  indeed,  by  which  the  subject  of  research 
itself  is  being  here  presented.  As  a  method  of  study  it  consists 
in  separating  the  subject  first  into  its  obvious  divisions;  then  in 
breaking  down  each  division  into  its  most  reasonable  subdivisions 
—as  shown  in  Chart  B  on  page  8.  Finally,  each  subdivision 
shown  on  the  chart  has,  in  a  separate  chapter,  been  further 
divided  and  considered  in  as  many  smaller  parts  as  are  necessary 
to  yield  a  full  and  clear  understanding  of  each  segregated  idea. 

It  is  quite  clear  that,  depending  upon  the  aptitude  with  which 
the  research  person  identifies  accurately  the  various  divisions, 
subdivisions  and  parts,  and  upon  the  perception  and  judgment 
with  which  he  interprets  the  significance  of  each  residual  idea,  a 
varying  measure  of  truth  can  be  attained  in  the  solution  of  any 
problem  involved  in  marketing. 

The  technique  elaborated  in  this  work,  therefore,  is  designed 
to  assist  the  research  worker  in  carrying  through  his  studies  in  a 
fixed  order.  It  enables  him  to  recognize,  with  as  much  certainty 
as  may  be,  the  component  parts  of  his  problem.  It  enables  him 
to  safeguard  himself  against  the  omission  of  any  pertinent  factor. 
It  sharpens  his  perception  with  respect  to  the  significance  of  his 
data  and  guides  his  judgment  in  interpreting  what  he  finds.  And 
it  can  be  applied  with  uniform  effect  to  any  problem  likely  to 
arise  in  the  experience  of  any  marketing  research  worker. 

Marketing  Research  Agencies 
As  this  treatise  progresses,  much  will  be  said  at  appropriate 
points  regarding  the  individual's  characteristics  and  the  equip- 
ment necessary  for  sound  research  work.     Certainly  the  approach 


INTRODUCTION  7 

to  any  marketing  problem,  whether  conducted  by  an  individual 
for  himself  or  for  an  agency,  should  be  in  the  spirit  of  science. 
Nothing  haphazard,  nothing  undertaken  in  anything  less  than  a 
strictly  scientific  spirit,  is  worthy  of  the  name  " research." 

What  this  scientific  spirit  is,  is  fairly  well  understood.  It  is 
that  element  which  in  other  fields  has  distinguished  research 
work  from  sheer  speculation  and  which  has  led  to  such  beneficent 
results  in  chemistry,  physics,  biology  and  even,  as  has  been  shown, 
in  the  more  pertinent  field  of  industrial  production.  This  spirit 
has  been  aptly  described  as  a  composite  of  certain  mental 
characteristics : 

"The  habit  of  accuracy  in  all  operations — including  calculation,  obser- 
vation and  report." 
"The  habit  of  intellectual  honesty." 
"The  habit  of  open-mindedness." 

"The  habit  of  looking  for  true  cause-and-effect  relationships." 
"The  habit  of  suspended  judgment." 
"The  habit  of  criticism — including  self-criticism."1 

It  is  not  contended  that  individuals  generally  possess  all  these 
commendable  habits  in  any  marked  degree.  Probably  few  do. 
But  the  nearer  to  such  a  composite  a  research  person  comes,  the 
better  equipped  he  is  to  undertake  the  work  and  the  more  likely 
are  his  conclusions  to  approximate  the  truth.  Certainly  these 
attributes  characterize  the  ideal  scientific  mind  and  each  of  them 
is  worthy  of  the  research  worker's  purposeful  thought  and 
cultivation. 

Chart  A  indicates  the  several  types  of  agencies  which  cus- 
tomarily do  marketing  research  work  and  whose  interests  require 
it.  The  character  of  these  agencies  is  too  well  known  to  warrant 
any  extensive  description.  It  is,  therefore,  sufficient  for  the 
purpose  of  this  work  merely  to  identify  them. 

Manufacturers  and  merchants — the  more  enlightened  ones — 
are  conducting  marketing  researches  to  support  their  own  sales- 
promotion  activities.  Various  trade  associations,  industrial 
institutes  and  chambers  of  commerce  are  making  studies  as  a 
service  to  their  members  and  for  the  advancement  of  their 
respective  industries  or  localities. 

1  Noll,  Victor  H.,  "The  Habit  of  Scientific  Thinking,"  Bureau  of  Publi- 
cations, Teachers  College,  Columbia  University,  1935. 
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Advertising  agencies,  almost  as  a  matter  of  necessity,  have 
developed  marketing  research  departments  for  the  benefit  of 
their  clients  and,  all  over  the  United  States,  publications  and 
other  media  are  conducting  studies  for  the  information  of  their 
advertisers  and  for  the  promotion  of  their  own  individual 
interests. 

The  Federal  government  is  doing  an  enormous  amount  of 
marketing  research  work  through  its  various  departments  and 
has  probably  gone  further  in  this  helpful  service  than  has  the 
government  of  any  other  country  in  the  world.  Supplementing 
all  this  are  many  valuable  studies  by  the  universities  and  colleges. 

Finally,  a  great  many  important  marketing  studies  are  being 
made  by  various  foundations  and  research  organizations.  Most 
of  these  are  of  a  general  character,  while  a  small  contingent  of 
individual  marketing  counselors  is  constantly  engaged  in  the  study 
of  specific  marketing  problems  in  all  parts  of  the  country. 

General  Comments 

In  developing  this  treatise,  it  has  been  no  part  of  the  purpose 
to  relate  the  text  to  any  particular  kind  of  survey  or  marketing 
study.  In  effect,  the  subject  has  been  resolved  into  its  ultimate 
components  and,  by  a  detailed  discussion  of  each  fragment,  the 
authors  have  sought  to  impart  enough  of  their  collective  practical 
experience  to  enable  each  reader  to  build  a  procedure  specific  to 
his  own  needs  and  adaptable  to  any  marketing  problem. 

In  connection  with  each  of  the  three  primary  periods — 
Preparation,  Execution  of  the  Program  and  Summation — there 
have  been  interpolated  some  very  necessary  and  instructive  notes 
on  psychological  techniques.  These  have  been  prepared  espe- 
cially for  this  work  and  contributed  by  Dr.  Paul  Felix  Lazarsf eld, 
who  has,  with  notable  results,  applied  his  principles  to  a  great 
many  practical  marketing  problems  in  this  country  and  in 
Europe. 

In  presenting  these  psychological  notes,  Dr.  Lazarsfeld  calls 
attention  to  the  fact  that  there  is  available  today  a  fairly  large 
selection  of  literature  regarding  techniques  of  interview.  On 
this  phase  of  research  work,  he  points  out,  a  student  can  find  all 
essential  information  in  one  of  the  current  texts.1     It  is  for  this 

1  Several  excellent  works  on  this  subject  are  included  in  the  bibliography 
in  the  back  of  this  book. 
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reason  that  the  psychological  notes  are  being  presented  only  in 
connection  with  the  three  operations  which  are  customarily 
conducted  on  the  inside  of  the  research  office.  On  these  phases 
the  literature  is  not  so  abundant. 

In  connection  with  the  notes  on  statistical  procedures  in 
marketing  research,  prepared  by  Alfred  T.  Falk,  it  seems  appro- 
priate also  to  remind  the  reader  of  the  rather  complete  range  of 
text  works  on  statistics.  Mr.  Falk's  notes,  Chap.  XIX,  neces- 
sarily touch  only  the  high  lights  but  they  are  included  to  make 
clear  the  importance  of  some  knowledge  of  statistical  processes 
and  to  encourage  the  student  reader  to  go  further  into  the 

subject.  g 

With  regard  to  the  scope  of  this  treatise,  the  reader  must  De 
prepared  to  regard  marketing  research  as  something  much  broader 
than  a  mere  "  counting  of  noses."  Those  whose  experience  or 
interest  centers  around  copy  testing,  for  instance,  or  around 
studies  designed  to  reflect  the  preferences,  reactions  or  attitudes 
of  numbers  of  people,  may  limit  their  concept  of  marketing 
research  largely  to  those  specific  and  like  activities  with  which 
they  are  most  familiar. 

In  this  work,  however,  the  authors  reach  around  and  beyond 
any  such  restricted  meaning.  They  adhere  throughout  to  the 
original  definition  of  marketing  research  as  "the  study  <rf  all 
problems  relating  to  the  transfer  and  sale  of  goods  and  services 
from  producer  to  consumer."  This  embraces  inquiries,  by  any 
of  the  available  methods,  into  any  situation,  circumstance  or 
condition— affecting  any  department  or  activity— within  the 
purview  of  the  marketing  phase— of  any  business  enterprise. 
This  is  a  method  of  study  and  it  is,  therefore,  susceptible  of  any 
application  within  its  natural  range. 

There  is  one  other  feature  which  might  well  be  brought  to  the 
reader's  attention  in  advance.  As  he  proceeds  through  the  book 
he  may,  now  and  then,  have  a  feeling  of  going  over  the  same 
ground  again.  This  arises  from  the  fact  that,  for  orderly  presen- 
tation, some  of  the  elements  must  be  viewed  under  different 
aspects.  The  questionnaire,  for  instance,  bobs  up  in  almost 
every  chapter.  From  some  points  of  view  it  is  concerned  in 
every  stage.  What  may  at  first  appear  to  be  repetition,  there- 
fore, will  be  found  instead  a  progressive  development  of  the 
elements  in  question. 
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Some  concern  may  be  felt  over  the  many  distinctions  in  terms 
employed  throughout  the  book.  Some  of  these  may  be  new  to 
the  reader — but  they  should  not  disturb  anyone.  No  one  has  to 
memorize  them,  or  even  to  accept  them.  They  represent  simply 
the  authors'  consensus  of  the  distinctions  necessary  to  convey 
clearly  and  in  full  all  the  ramifications  of  the  subject  which  they 
believe  essential  in  a  definitive  work  of  this  kind. 
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CHAPTER  I 
ANALYSIS  OF  THE  PROBLEM 

(As  Presented  in  Chart  C) 

This  is  the  first  stage  in  the  preparatory  period  of  any  market- 
ing research.  Research  problems  originate  in  many  ways.  A 
general  study  may  grow  from  the  government's  desire  to  foster 
and  facilitate  commerce — as  The  Distribution  Census;  an  advertis- 
ing agency  may  undertake  such  a  study  for  prestige  or  for  service 
to  clients — as  J.  Walter  Thompson's  Population  and  Its  Distribu- 
tion; a  foundation  like  The  Brookings  Institution,  may  undertake 
studies  purely  in  the  public  interest.  As  a  rule,  these  general 
studies  do  not  arise  suddenly.  The  desire  or  the  need  for  them 
emerges  so  gradually  that  the  analysis  develops  naturally  and 
concurrently  as  part  of  the  same  process. 

With  specific  studies  the  situation  is  usually  quite  different. 
A  new  policy  is  contemplated;  one  company  is  planning  to  buy 
out  another;  a  company  wants  to  put  on  a  new  product  or  open 
a  new  market;  a  business  is  mysteriously  losing  in  volume  and 
profit;  a  new  advertising  approach  is  to  be  tested — all  such  prob- 
lems require  action  more  or  less  immediately.  Analysis,  then, 
takes  on  the  aspect  of  a  distinct  operation  and  it  embraces  defi- 
nitely the  four  major  steps  shown  On  the  chart. 

The  process  of  analyzing  the  problem  is  primarily  a  thinking 
operation.  Scarcely  any  two  problems  are  identical  in  all  respects. 
Each  one  has  to  be  contemplated  alone.  But  the  technique  is 
uniform.  It  is  the  same  formula:  a  successive  reduction  of  the 
subject  into  parts  with  the  idea  of  extracting  from  each  fragment 
such  guidance  as  it  may  be  made  to  yield. 

Determine  Purpose  and  Range 

It  is  well  to  realize  at  once  the  very  special  character  of  this 

first  step— the  crucial  nature  and  necessity  of  defining  exactly 

the  purpose  of  the  research.     This  step  represents  that  most 

important  deliberation  before  action  which  is  needed  to  clarify 

13 
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with  precision  the  aim  of  all  the  work  that  is  to  follow.  It  should, 
therefore,  be  entered  upon  with  circumspection,  as  the  master 
step  of  the  entire  project— in  order  that  both  the  purpose  and  the 
range  of  the  study  may  be  denned  with  the  greatest  possible 
realism  and  practicality. 

A  graphic  way  of  describing  the  key  nature  of  this  step  is  to 
compare  it  to  the  action  of  a  trained  fireman  arriving  at  a  blaze. 
Quite  unlike  the  untrained  person  whose  inclination  is  to  dash 
into  action  immediately  and  "do  something,"  however  vague 
or  ill-considered  or  dangerous,  the  trained  fireman  stops  first 
of  all  to  consider  what  his  immediate,  practical  objective  shall  be. 
The  really  important  first  objective  may  be  to  rescue  human 
beings;  to  turn  in  a  general  alarm;  to  shut  off  the  gas  main;  to 
concentrate  on  preventing  the  blaze  from  reaching  adjoining 
property;  or,  perhaps,  merely  to  close  certain  doors  and  windows 
in  order  to  cut  off  the  draft.  The  cool  attention  the  trained 
person  gives  to  deciding  upon  a  precise  objective,  as  he  stands 
for  a  brief  interval  seemingly  idle,  may  be  the  decisive  factor  in 
a  situation  on  which  much  depends. 

Ultimate  Objectives.  All  those  who  have  analyzed  the 
process  of  thinking,  Dewey,1  Tead2  and  others,  have  agreed  that 
the  very  first  step  is  adequate  recognition  of  the  problem — 
comprehending  the  issue  in  its  entirety  and  without  confusion. 
There  is  no  more  certain  way  to  a  full  comprehension  of  an  issue 
than  by  reducing  it  to  concrete  form.  Whether  the  problem 
be  simple  or  complex,  the  mere  act  of  expressing  it  in  precise 
terms  will  stimulate  and  direct  all  subsequent  thinking. 

Further,  unless  the  goal  is  clearly  marked,  there  can  be  no  such 
thing  as  driving  straight  ahead;  the  study  could  not  be  held 
steadily  to  any  fixed  course;  and  it  would  be  impossible,  except 
by  pure  chance,  to  arrive  at  authoritative  conclusions  on  a  sub- 
ject only  vaguely  discerned.  Research  which  just  wanders 
around  accumulating  facts  without  knowing  the  whole  objective 
of  the  procedure  is  bound  to  be  futile,  disappointing,  wasteful 
and,  perhaps,  even  dangerously  incompetent. 

Consider,  for  example,  a  large  corporation  with  a  plant,  say, 
in  Saint  Louis,  making  a  product  little  understood  or  appreciated 

1  Dr.  John  Dewey,  Professor  of  Philosophy,  Columbia  University. 

2  Dr.  Ordway  Tead,  author  of  Creative  Management — The  Relation  of 
Aims  to  Administration,  Association  Press,  New  York,  1936. 
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by  the  public  and  losing  money  too  fast  for  safety.  Eventually 
the  corporation  reaches  a  point  at  which  it  must  decide  whether 
to  close  the  plant,  pocket  the  loss  and  call  it  a  day,  or  to  venture 
more  money  in  a  desperate  effort  to  win  back  the  capital  already 
lost. 

The  financial  and  social  consequences  of  either  course  make 
imperative  a  sound,  carefully  conducted,  disinterested,  factual 
study. 

Reduced  to  exact  terms,  the  ultimate  objectives  in  such  a 
study  might  be  written  thus: 

To  determine  whether  or  not  that  plant,  situated  as  it  is  and 
in  view  of  all  the  ascertainable  circumstances,  can  be  made  to 
yield  profits  consistently  commensurate  with  the  investment — 
and  by  what  means — and  how  soon. 

It  is  important  that  at  least  the  director  of  the  study  have 
these  clearly  expressed  objectives  before  him,  from  the  very 
beginning  of  the  work.  A  knowledge  of  the  use  to  which  the 
conclusions  are  to  be  put,  the  ultimate  objective,  necessarily 
clarifies  the  thinking  of  the  person  who  is  later  to  interpret 
the  data. 

Immediate  Objectives.  Sometimes  the  attainment  of  such 
an  ultimate  objective  requires  separate  inquiries  along  different 
lines.  These  represent  the  "immediate  objectives."  In  the 
Saint  Louis  situation,  for  example,  one  immediate  objective  might 
be  to  determine  why  the  product  has  not  been  made  to  interest 
the  public;  another  immediate  objective  might  concern  the 
competency  of  the  company's  management;  still  another  might 
relate  to  the  company's  sales  and  advertising  work. 

Another  illustration:  A  group  of  electric  light  and  power  com- 
panies wanted  to  increase  the  sale  of  their  product — electric  cur- 
rent. Their  desire  for  more  business  made  their  ultimate 
objective  fairly  obvious.  Their  immediate  objectives,  however, 
were  not  quite  so  clear.  Analysis  disclosed  a  series  of  uncer- 
tainties resting  on  concrete  questions;  each  of  these  uncertainties 
became  the  immediate  objective  of  a  special  and  necessary  study, 
as  follows : 

"  1.  Do  commercial  or  domestic  users  present  the  better  field  for  promotion? 
A  study  of  the  records  of  the  several  companies  clearly  indicated  that 
the  domestic  users  presented  the  more  promising  field.  Then,  the 
second  immediate  objective  became  apparent. 


16  THE  TECHNIQUE  OF  MARKETING  RESEARCH 

2.  How  can  domestic  users  be  brought  to  consume  more  current? 

Another  study  of  records,  combined  with  a  survey  of  the  facilities  and 
requirements  in  the  field,  showed  that  a  wider  distribution  of 
electrical  household  appliances  would  most  likely  accomplish  this 
purpose.     The  next  question  then  became — 

3.  Are  the  service  companies  equipped  to  undertake  a  promotional  cam- 
paign on  such  appliances? 

A  study  of  personnel,  inside  the  sales  rooms  and  in  the  field,  proved 
that  the  salesmen  were  not  so  equipped  and  that  they  were  generally 
lacking  in  training.     Then  arose  this  question — 

4.  What  should  salesmen  be  taught  in  order  successfully  to  sell  electrical 
household  equipment? 

A  study  of  the  tactics  of  leading  firms;  consultations  with  executives 
and  the  top  salesmen  in  each  of  the  companies  involved;  persistent 
search  in  the  field  to  identify  the  sales  resistances;  conferences, 
observations  and  tests  to  overcome  such  resistances;  experiments 
with  presentations,  displays  and  demonstrations;  and  other  such 
investigations — all  culminated  in  a  training  course,  backed  by  a  sales 
manual  built  on  a  solid  foundation  of  fact  and  experience. 

To  recognize  these  immediate  objectives,  and  sometimes  even 
a  single  one,  with  certainty  is  not  so  simple  as  it  may  seem. 

Often  a  business  executive  calling  in  a  research  man  or 
counselor  discloses  during  the  initial  conference  that  the  problem 
which  he  had  thought  to  be,  for  example,  "Why  are  our  dealers 
not  pushing  harder?"  should  be  changed  to  a  more  fundamental 
one — "What  are  the  reasons  for  consumer  indifference  to  our 
line?"  The  first  question  would  involve  an  external  study, 
one  having  to  do  almost  wholly  with  the  situation  among 
" dealers"  out  in  the  field;  the  second  study  would  be  largely 
internal  and  exploratory  seeking  causative  weaknesses  in  the 
firm's  "policies/'  its  "product,"  the  "market"  in  which  it  is 
working  and  the  "methods  and  means"  (selling— advertising- 
service)  employed  in  its  marketing  process. 

Here  is  an  actual  example  of  such  a  situation:  The  executives  of 
a  certain  substantial  corporation  suddenly  decided  to  stop  all 
advertising!  This  corporation  made  fancy  woodwork  for  interior 
decoration — for  counters,  partitions,  mantels,  paneling,  etc.  It 
was  the  leader  in  its  field  and  distinctly  a  quality  house. 

The  advertising  was  to  be  stopped  because  the  executives  had 
found  that  in  earlier  years— before  they  had  thought  of  advertis- 
ing at  all— their  net  profits  had  been  consistently  about  10  per 
cent,  year  in  and  year  out;  but  that,  when  they  experimented 
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with  a  little  trade-paper  advertising  their  profits  had  declined 
to  about  8  per  cent;  and  later,  when  they  tried  advertising  on  a 
still  larger  scale,  their  profits  shrank  to  3  per  cent. 

To  the  executives  this  seemed  to  prove  that  the  more  advertis- 
ing they  did,  the  less  profit  they  achieved.  They  had  come  to 
believe  that  their  kind  of  business  was  not  suitable  for  advertising. 
They  were  convinced,  therefore,  that  by  cutting  out  all  advertis- 
ing their  profits  would  go  back  to  the  previous  normal  level  of 
10  per  cent.  Incidentally,  that  was  just  about  what  they  had 
been  spending  in  advertising. 

Naturally,  the  advertising  agency  was  very  much  concerned. 
Not  only  was  it  losing  a  substantial  appropriation,  but  the  whole 
philosophy  of  advertising  was  under  attack.  The  officials  of  the 
agency,  therefore,  decided  to  do  something  about  it.  They 
persuaded  the  client  to  permit  them  to  make  a  careful  analysis 
of  the  company's  profit-and-loss  statements  over  a  period  of 
years — to  see  whether  they  could  determine  with  any  certainty 
just  why  profits  should  decline  in  spite  of  increased  advertising. 

The  advertising  agency  set  up  the  profit-and-loss  figures  for 
fourteen  consecutive  years.  This  represented  an  analysis  of  the 
company's  gross  receipts  and  showed  in  detail  just  how  those 
receipts  had  been  distributed  each  year.  Two  vital  facts  became 
immediately  apparent:  The  actual  cost  of  making  sales  had 
declined  progressively  as  the  advertising  increased;  and,  the 
production  cost  had  been  advancing — as  a  result  of  the  steadily 
rising  costs  of  raw  materials.  It  was  this  latter  factor  which 
was  absorbing  the  company's  profits. 

Two  possible  explanations  occurred  to  the  advertising  agency 
to  account  for  the  advancing  ratio  of  production  cost :  First,  that 
perhaps  the  purchasing  department  was  at  fault  in  failing  to 
buy  at  the  right  times  or  at  the  right  prices;  second,  that  the 
corporation's  own  price-making  system  was  at  fault. 

Since  further  studies  showed  no  deficiency  in  the  buying  per- 
sonnel or  habits,  the  company's  repricing  policies  were  examined. 
It  was  found  that  each  branch  and  each  sales  office,  scattered 
throughout  the  country,  was  allowed  to  make  its  own  prices  to 
meet  local  competition.  It  began  to  appear  that  the  branch 
office  salesmen  were  not  getting  enough  for  their  product. 

A  study  was  then  directed  toward  the  company's  selling  per- 
sonnel and  policies.     The  question  was:  "Why  do  the  salesmen 
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fail  to  get  the  right  prices?"  This  study  disclosed  the  funda- 
mental fact  that  the  salesmen  were  not  selling  woodwork  at  all- 
in  its  true  sense.  They  were  selling  lumber— competing  with 
local  lumber  dealers.  They  were  selling  the  company's  carefully 
machined  and  finished  woodwork  as  though  it  were  nothing  but 
dressed  board!! 

The  result  of  this  study  was  a  thoroughly  developed  sales 
school,  which  taught  the  salesmen  how  to  sell  woodwork  at  a 
profit.  The  advertising  was  not  only  continued  but  increased 
and  the  company's  profit  soon  approached  the  best  figures  of  the 
past.  To  have  stopped  all  advertising— as  the  executives  had 
planned — would  have  been  a  disaster. 

As  a  matter  of  fact,  the  business  executive  is  generally  the 
person  least  qualified  to  identify  the  purposes  of  a  study.  He  is 
too  close  to  his  problem;  he  begins  with  preconceived  notions; 
he  is  permeated  with  traditional  concepts,  often  false;  he  is 
addicted  to  methods  perhaps  long  outmoded;  he  is  enmeshed  in 
office  politics;  his  leadership  or  his  job  or,  more  commonly,  his 
vanity  may  be  at  stake.  The  very  nature  of  research  work  calls 
throughout  for  a  person  utterly  detached  from  all  self-interest 
in  considering  the  problem,  its  origin  or  the  consequences  of  its 
solution. 

The  marketing  research  mind,  one  habituated  to  the  scientific 
approach  and  seasoned  with  some  experience,  is  almost  indis- 
pensable in  determining  these  essential  purposes  in  research 
work.  Such  a  mind  can  be  depended  upon  to  resolve  the  study 
disinterestedly  and  accurately  into  its  elements;  to  formulate 
the  purposes  precisely  and  to  relate  them  soundly  to  a  research 
procedure.  In  this  deliberative  stage,  even  the  purely  technical 
market  research  man  is  at  a  disadvantage,  since  his  training 
is  usually  limited  to  securing  the  (lata  after  the  purposes  and  the 
procedure  have  been  determined. 

Although  the  research  person  must  maintain  a  completely 
open  mind,  uninfluenced  by  opinions  at  variance  with  evidence, 
marketing  studies  almost  invariably  necessitate  a  succession  of 
conferences  with  officials,  salesmen,  shipping  clerks,  office  boys 
and  everyone  else  within  the  organization  or  outside  of  it  who 
might  by  any  possibility  throw  light  on  the  situation  as  it  exists. 
Information  so  procured  may,  when  considered  in  the  light  of 
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other  data  or  observations,  assist  greatly  in  clarifying  the  purposes 
of  the  study. 

In  addition  to  all  other  methods,  it  is  sometimes  necessary 
even  to  make  a  special  preliminary  survey  or  analysis.  The 
whole  process  is  a  veritable  probe  to  find  out  just  what  it  is  that 
needs  to  be  studied;  to  locate  with  certitude  the  pertinent 
purposes  and  so  to  formulate  them  as  to  insure  the  inclusion  of 
every  significant  factor. 

Scope  of  the  Study.  The  process  of  defining  the  purposes 
of  a  study  may  at  the  same  time  establish  its  boundaries.  Just 
how  far  is  the  researcher  to  go  in  pursuit  of  the  objectives? 

The  problem  may  be  sufficiently  simple  to  solve  forthwith, 
out  of  the  research  man's  own  experience  in  marketing;  or  it  may 
be  settled  by  a  few  elemental  facts  readily  obtainable  in  some  of 
the  reference  books;  or  it  may  require  a  great  deal  of  very  earnest 
thought  and  considerable  sound  judgment. 

Consider,  for  example,  the  question:  "Is  Keokuk,  Iowa,  a  large 
enough  market  to  warrant  some  special  sales  or  advertising 
work?"  A  very  superficial  research  will  disclose  the  population 
of  Keokuk,  the  number  of  wholesale  and  retail  dealers,  the 
character  of  the  people — their  income  levels,  buying  habits  and 
disposition — the  number  of  homes  owned  and  of  automobiles 
registered  and  all  the  other  data  necessary  for  determining  the 
suitability  of  Keokuk  for  the  proposed  work — so  far  as  its  size 
is  concerned. 

If  other  questions  are  involved — concerning,  for  instance, 
the  suitability  of  the  product  as  to  kind,  quality,  price,  style, 
etc.,  to  such  people  as  live  in  Keokuk;  or  the  accessibility  of 
Keokuk  for  servicing;  or  questions  regarding  any  special  competi- 
tive condition  that  might  exist  in  that  market  and  which  might 
affect  the  proposed  special  work — the  problem  would  take  on  a 
more  complicated  character.  But,  even  in  such  problems  a 
fairly  simple  analysis  should  serve,  at  least  roughly,  to  disclose 
the  magnitude  or  scope  of  the  project  and  to  indicate  the  general 
direction  the  study  should  follow. 

Marketing  situations  which  are  definitely  complex  call  for  a 
procedure  which  can  leave  no  question  as  to  the  scope  of  a  study. 
As  a  rule,  such  studies  involve  more  than  a  single  aspect  of  a 
business.     Formerly  the  procedure  in  determining  the  scope  of  a 


20  THE  TECHNIQUE  OF  MARKETING  RESEARCH 

research  in  these  cases  was  to  conduct  an  actual  study,  prelimi- 
nary in  character  and  proportions.  That  usually  disclosed  just 
how  far  one  would  have  to  go  to  reach  the  ultimate  objectives. 
Now  the  procedure  frequently  includes  a  resort  to  check  lists. 

A  check  list  is  a  catalogue  of  questions,  or  it  may  be  an  array  of 
declarations,  designed  to  stimulate  the  mind  in  its  search  for  data 
and  to  guide  the  researcher  into  recesses  of  the  business  in  which 
the  desired  information  may  be  hidden.  These  lists  are  prepared 
with  great  deliberation  and  afford  an  effective  safeguard  against 
material  omissions. 

One  of  the  first  check  lists  to  be  made  public  was  the  Sales 
Expansion  Question  Book  of  Ray  Giles.1  This  is  a  book  of  nearly 
700  questions  which  Mr.  Giles  reports  using  with  new  clients 
of  the  Blackman  Company  to  discover  what  their  clients'  market- 
ing problems  were.  Still  another  such  device  is  the  Analytical 
Outline  used  by  Cowan  and  Dengler,  Inc.,  an  advertising  agency, 
for  the  same  purpose.  Applicable  particularly  to  the  industrial 
field  is  the  Balzari  Check-Chart,  published  by  the  McGraw-Hill 
Publishing  Company,  Inc.  This  chart,  as  shown  in  Fig.  1,  on 
pages  22  and  23,  presents  on  one  sheet  3,600  questions  to  aid  the 
researcher  in  putting  his  finger  on  the  possible  marketing  prob- 
lems of  an  industrial  business.  The  Domestic  Division  of  the 
Bureau  of  Foreign  and  Domestic  Commerce  has  also  published 
a  check  list  to  be  used  in  analyzing  both  consumer  and  industrial 
marketing  problems. 

The  most  important  advantages  of  such  check  fists  are: 
First,  they  carry  the  researcher  through  a  wide  range  of  possible 
questions  as  an  aid  in  fixing  the  purposes  of  a  study,  and  second, 
they  obviate  aimless  digressions  into  inconsequential  or  unprof- 
itable fields  with  consequent  waste  of  time,  effort  and  money. 

Determine  What  Facts  Are  Required 

Probably  the  most  effective  instruments  for  determining 
what  facts  are  required  in  any  given  marketing  study  are  the  check 
lists  just  referred  to. 

In  general,  all  marketing  problems  fall  within  one  or  more 
clearly  defined  classes  or  types.  It  is  difficult  to  conceive  of  any 
question  in  marketing  which  does  not  concern  the  underlying 

1  Giles,  Ray,  The  Sales  Expansion  Question  Book,  Harper  &  Brothers, 
New  York,  1930. 
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four  categories  previously  referred  to — the  "policies,"  the 
"products,"  the  "markets,"  the  "methods  and  means" — of 
either  the  firm  in  which  the  problem  arises  or  its  competitors. 
For  example: 

Policy — First  Category.  Into  this  class  fall  all  such  ques- 
tions as:  What  should  be  the  company's  policy  with  respect  to 
pricing,  to  cancellations,  returned  goods,  the  giving  of  credit, 
discounts,  advertising  allowances,  concessions,  entertainment, 
inventory,  turnover,  general  attitude  toward  customers  or 
public,  etc.,  etc.?1 

Product — Second  Category.  This  class  embraces  all  such 
questions  as:  Does  the  firm's  product  fully  meet  the  customer's 
needs — tastes— ideas  ?  Is  it  competitive  in  price— quality — 
size — style?  Would  any  change  in  color,  texture,  flavor  or 
other  physical  feature  or  property  facilitate  sales,  etc.,  etc.? 

Market — Third  Category.  Questions  illustrative  of  this 
class  would  be;  What  areas,  if  any,  are  destined  to  remain 
unprofitable?  Where  and  to  whom  can  the  product  be  sold 
most  profitably?  What  class  of  consumers  buys  the  product? 
What  class  does  not?  What  are  the  factors  of  location,  age, 
occupation,  sex,  race  involved?  Who  are  the  firm's  competitors, 
and  what  competitive  activities  are  likely  to  retard  the  firm's 
own  sales,  etc.,  etc.? 

Methods  and  Means — Fourth  Category.  Here  .would  go  all 
the  questions  which  have  to  do  with  sales,  advertising  and  service, 
such  as :  Are  the  salesmen  informed  as  to  the  product — its  use — 
the  company  itself— its  policies— its  facilities?  Are  they  ade- 
quately trained  in  the  field  work?  Is  the  advertising  adequate, 
consistent,  tested,  effective?  To  what  extent  is  the  company's 
business  being  affected  by  the  advertising  or  sales  work  of  com- 
petitors? Is  any  competitor  giving  better  value  or  rendering 
more   service?     Does  the  firm  maintain   adequate  records   of 

1  Note:  Policy  touches  every  nook  and  corner  of  every  business.  This 
fact  is  extremely  important  in  constructive  marketing  work.  It  is  demon- 
strable that  practically  every  weakness  found  afflicting  any  business  enter- 
prise has  its  inception  in  some  policy  and  can  be  rectified  only  by  a  change  in 
that  policy.  Unfortunately  for  progress,  however,  executives  who  control 
policies  too  often  disdain  intimations  of  this  tenor— even  when  supported  by 
irrefutable  data.  Happily,  the  time  must  come  when  marketing  research 
will  be  universally  regarded  as  a  scientific  aid  to  management,  and  not 
merely  a  studied  aspersion  on  its  weaknesses. 
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Fig.  1. — Check  list  showing  approximately  3,600  features  which  may 


ANALYSIS  OF  THE  PROBLEM 


23 


MARKETING 

CHART 

Controllable  Policies  in  Economical  Distribution.-., 
to  Industry  Wishes  to  Improve  His  Marketing  Position  One  or  More  of  the  Following  Marketing  Elements  ofHisBttsintn  Must  St Changed 

III 

IV 
The  Use  of 
Salesmen 

V 
The  Use  of 

Distributors 

VI    The  Use  of  Sales  Promotion 

VII 

Industry 

Co-operative  Effort 

■vices  Rendered 
To  Customers 

1  Publication 
Advertising 

2   Direct 
Mail 

3  Catalogs  St 
Directories 

4  Exhibits*  5  Si  lent  ti  Sound 
Trade  Shows  Motion  Pichra  .Slides 

v'/Jy 

W//A 

' w/aW/aWa0MWJM 

/$/wjA 

Af/JA  / 

y //*/%? V //^/<aW^ 

fty 

IAcCnwHiU%JkMna  Company.  Inc. 

i 

— 

Teq 

ui 

re 

St 

U( 

iy 

ir 

1  c 

OI 

in 

ec 

ti( 

)n 

w 

it! 

i  1 

bh 

e  i 

212 

ir 

ke 

tii 

lg 

of 

ir 

id 

US 

tr 

ia 

1 1 

rc 

di 

JC 

ts. 

' 

24  THE  TECHNIQUE  OF  MARKETING  RESEARCH 

sales— by  lines,  by  items,  by  customer,  by  territories,  by  sales- 
men? Is  the  firm's  method  of  compensating  salesmen  the  most 
effective?  What  is  the  relative  cost  of  distribution  through 
various  channels?  What  is  the  effect  upon  profits  of  various 
methods — etc.,  etc.? 

Reference  to  any  of  the  available  check  lists  will  show  that 
questions  such  as  these  can  be  elaborated  into  hundreds.  Every 
one  of  them  might  have  a  bearing  on  a  company's  sales  and 
profits,  and  at  least  the  basic  questions  ought  to  be  considered  in 
analyzing  any  marketing  problem.  Here  we  have  confined  our- 
selves to  only  a  few  questions,  merely  to  demonstrate  the  fact 
that  practically  all  problems  in  the  field  of  marketing  are  related 
to  one  or  more  of  the  four  basic  categories. 

Another  interesting  reflection  concerning  these  four  categories 
is  the  difference  in  range  between  the  two  objective  fields  of 
inquiry  and  the  two  subjective  ones.  Considerations  of  the 
"product"  and  the  "market,"  the  objective  fields,  are  specific 
to  those  subjects;  whereas,  considerations  of  "policy"  and 
"methods  and  means,"  the  subjective  fields,  operate  on  and 
through  product  and  market  to  produce  profit— or  loss— as 
management  plus  normal  opportunity  may  determine. 

This  distinction  is  significant.  It  underlies  the  crucial  impor- 
tance of  management  and  stresses  the  imperative  need  for 
exploring  it  in  every  marketing  study.  This  is  particularly  true 
in  such  studies  as  are  designed  to  inaugurate  a  new  enterprise, 
a  new  activity  or  a  new  product;  or  to  explain  the  loss  of  leader- 
ship in  a  market;  or  to  find  and  correct  the  factors  responsible 
for  a  decline  or  a  stasis  in  volume  or  profit. 

Determine  Where  Facts  Are  to  Be  Found 
The  sources  of  information  required  in  marketing  research 
are  of  two  general  types:  internal  and  external.  The  first  type 
includes  all  such  facts  as  may  be  found  within  the  business  or 
the  organization  itself  and  the  second  embraces  all  such  facts 
as  must  be  sought  in  the  field  outside.  In  the  chapters  dealing 
with  the  Collection  of  Data  the  subject  of  sources  will  be  some- 
what elaborated.  Here  we  are  concerned  only  with  a  broad 
classification  for  the  purpose  of  a  primary  analysis  of  the  problem. 
Internal.  One  of  the  curious  ideas  current  in  some  business 
circles  is  that  research  is  intended  only  for  problems  which  lie 
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on  the  outside.  A  business  administrator,  for  instance,  might 
complain  that  his  advertising  "  doesn't  seem  to  have  any  pull." 
He  concludes  that  his  advertising  must  be  all  wrong.  He  wants 
a  research  man  to  find  out  about  it.  It  seems  never  to  occur  to 
such  an  administrator  that  what  appears  to  be  the  failure  of  his 
advertising  may  in  reality  be  a  purely  internal  maladjustment. 
His  policies  may  be  completely  out  of  harmony  with  the  require- 
ments of  his  customers;  he  may  have  picked  the  wrong  market; 
his  product  may  be  deficient  in  quality,  style  or  price;  or  his 
approach  to  the  market,  his  selection,  training  and  direction  of 
salesmen  may  be  infelicitous;  his  competitors  may  be  running 
rings  around  him  in  service.  Indeed,  his  own  ineptitudes  may, 
in  a  hundred  ways,  be  depriving  his  advertising  of  its  rightful 
opportunity. 

This  idea  was  exemplified  in  the  woodwork  story  on  page  16. 
The  executives  of  that  firm  were  blaming  advertising  for  a 
weakness  in  the  management  for  which  they  alone  were  responsi- 
ble and  which  they  might  have  discovered  for  themselves,  had 
they  not  been  too  close  to  their  problem. 

In  analyzing  a  situation,  therefore,  it  would  certainly  be 
derelict  not  to  examine  critically  the  internal  factors  of  the 
business.  If  a  new  activity  is  contemplated,  the  management 
should  assure  itself,  on  disinterested  authority,  that  it  is  prepared 
internally;  that  it  has  the  spirit,  the  skill,  the  industry  and  the 
character  to  push  the  new  venture  through  resolutely  to  success. 
If  the  study  is  a  search  for  retarding  factors,  the  inside  of  the 
business  is  the  most  promising  field— because  there  is  where  the 
responsibility  is.     So,  the  inside  should  never  be  overlooked. 

The  sources  within  the  business,  from  which  data  may  be 
drawn,  may  be  concrete  or  abstract  in  nature. 

concrete.  As  the  word  indicates,  this  includes  all  the 
objective  sources  of  data  which  are  to  be  found  within  the  busi- 
ness. These  sources  have  to  do  with  evidence  which  is  positive 
in  character  and  generally  measurable.  The  more  common  of 
these  concrete  sources  are  the  profit-and-loss  statements,  past  and 
present  reports  of  salesmen,  sales  records,  sales  correspondence, 
customer  ledgers,  mailing  lists  and  all  other  such  sources  as  are 
of  record  in  the  business. 

These  sources  yield  information  regarding  sales  by  individual 
customers,  trading  areas  or  sales  territories,  by  salesmen,  by 
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product  and  by  size  of  order;  they  will  also  show  changes  in 
product-demand,  the  reasons  for  these  changes,  the  relation  of 
sales  to  business  conditions  generally;  and  they  supply  much 
of  the  material  upon  which  sales  forecasts  are  usually  based.1 

abstract.  Facts  of  a  less  definite  nature,  but  none  the  less 
important,  are  drawn  from  intangible  sources.  They  arise  as  a 
sort  of  aura— sometimes,  indeed,  as  a  miasma—found  enveloping 
the  executive  and  marketing  departments  of  a  business.  Through 
such  an  atmosphere  may  be  discerned  more  or  less  clearly  the 
effect  of  the  imponderable  elements  of  management— its  policy 
with  respect  to  the  various  instrumentalities  of  the  business; 
its  ^attitude  for  or  against  progressive  aims  and  practices  and 
the  personal  habits  and  foibles  of  individuals  in  position  sub- 
stantially to  affect  the  marketing  processes  of  the  firm  for  good 

or  ill. 

The  following  example  will  illustrate  the  distinction  between 
concrete  and  abstract  sources  of  data.  A  certain  manufacturer 
of  foods  had  a  study  made  to  find  out  what  was  retarding  his 
development  in  a  large  and  nearby  market.  The  concrete  sources 
—salesmen's  and  customers'  records— revealed  several  weak- 
nesses; among  them  was  one  which  is  quite  common  and  too 
frequently  overlooked  by  manufacturers  of  consumer  products— 
the  matter  of  repeat  business. 

Involved  in  this  study  was  a  group  of  about  a  dozen  distinct 
lines  of  products  and  only  one  of  them  could  claim  anything  like 
a  consistent  repeat  history.  Practically  all  the  sales  in  all  the 
other  lines  were  of  the  costly  introductory  character  and  very 
few  outlets  were  ever  built  up  to  any  degree  of  regularity  on 

any  of  them. 

Customers  to  whom  introductory  sales  were  made  in  these 
lines  fell  away  at  about  the  same  rate  at  which  new  customers 
were  being  started.  This  made  it  all  replacement  business.  It 
was  like  trying  to  fill  a  barrel— with  the  water  running  out  from 
the  bottom  as  fast  as  it  was  poured  in  at  the  top.  A  food  business 
which  depends  on  a  multiplicity  of  small  sales  could  not  grow 
under  any  such  conditions.  Such  a  weakness  must  be  corrected 
the  moment  it  is  found— but  first  it  must  be  discovered. 

i  Witherspoon,  J.  J.,  "Budgeting  Territorial  Sales,"  Printers'  Ink 
Monthly,  March,  1930. 
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It  will  be  seen  that  the  concrete  sources  of  data  were  the  ones 
which  revealed  this  weakness;  but  it  is  to  the  abstract  sources 
that  one  must  look  for  the  underlying  causes — in  this  case  the 
failure  of  management  to  comprehend  the  imperative  need  for 
repeat  business  and  the  failure  to  apply  sufficient  pressure  to 
secure  it. 

External.  Sources  of  this  type  are  referred  to  for  information 
concerning  the  dealers  and  consumers  who  do  or  might  buy  the 
company's  products.  The  corresponding  products  and  the 
activities  of  competitors  are  also  fruitful  and  necessary  sources 
of  information.  Additional  data  may  be  drawn  from  authorities 
who  have  special  knowledge  of  the  product  or  of  the  most 
appropriate  markets  or  who  have  had  more  than  average  experi- 
ence with  the  difficulties  to  be  encountered  in  selling  or  advertis- 
ing the  same  or  similar  products. 

groups.  External  sources  of  this  type  are  naturally  studied 
for  data  concerning  the  race,  sex,  age-distribution,  occupation, 
incomes  of  prospective  customers  and  other  such  elements. 
Material  of  this  sort  is  indispensable  to  most  marketing  studies 
because  of  the  increasing  influence  of  these  factors  on  both 
advertising  and  selling. 

areas.  Geographical  divisions  must  be  studied  for  informa- 
tion on  the  accessibility  of  markets,  as  well  as  on  topography, 
climate  and  other  factors  which  might  affect  sales  work  and 
deliveries  in  various  sections  of  the  country  or  which  might 
notably  affect  the  consumption  of  the  product  in  those  areas. 
Sources  of  this  sort  must  also  be  studied  with  great  care  in  plan- 
ning both  sales  and  advertising  campaigns  and  for  the  convenient 
handling  of  any  wide-flung  sales  force. 

bibliography.  Since  the  close  of  the  World  War,  thousands 
of  studies  have  been  made  and  are  currently  being  made  dealing 
with  marketing  in  its  various  phases.  Many  of  these  studies 
have  been  recorded  and  are  readily  available  for  inspection. 
Among  these  there  are  a  number  of  general  studies  and  others 
dealing  with  commercial,  economic  and  social  subjects  which 
throw  considerable  light  also  on  marketing  problems.  Cer- 
tainly, before  embarking  on  any  extensive  research  and,  as  a 
matter  of  economy,  the  appropriate  bibliography  should  be 
examined  for  pertinent  material. 
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There  are  two  observations  to  be  made  here  in  connection  with 
bibliographical  sources:  first,  as  to  where  they  are  to  be  found; 
and  second,  by  way  of  caution  as  to  their  reliability.  In  general, 
bibliographical  data  may  be  drawn  principally  from  libraries, 
governmental  departments,  trade  associations,  bureaus  of  busi- 
ness research,  advertising  agencies  and  publishers — sources 
referred  to  more  specifically  in  a  later  chapter. 

Bibliographical  sources  are  important  and  have  real  contribu- 
tions to  make  to  the  solution  of  nearly  every  kind  of  problem 
that  could  possibly  arise  in  marketing.  Anyone  engaged  in 
marketing  work  should  make  himself  familiar  with  its  literature 
as  quickly  as  possible  and  he  should  keep  abreast  of  all  the 
current  publications  as  well. 

It  is  necessary  to  realize,  however,  that  such  works,  if  used 
as  sources,  must  be  reliable.  In  testing  their  reliability  there  are 
certain  aspects  to  be  examined  which  fall  generally  into  two  cate- 
gories— the  text  and  the  authorship : 

The  inquiry  as  to  text  has  to  do — 

with  the  determination  of  all  the  conditions  which  may  have  influenced 
the  production  of  the  document— the  date,  the  place,  the  purpose  and 
the  circumstances  of  its  composition;  whether  it  is  an  original  or  a  copy; 
whether  a  sound  or  a  corrupt  text;  whether  in  complete  form  or  partially 
destroyed  and  whether  susceptible  of  emendation.1 

For  example,  in  considering  the  reports  of  newspapers  and 
periodicals  with  respect  to  their  readership,  all'  the  influences 
which  might  cause  their  representatives  innocently  to  exaggerate 
their  market  or  circulation  must  be  taken  into  account. 

The  inquiry  into  authorship  is  concerned  first  with  identifying 
the  author  and,  second,  with  examining  the  author's  qualifica- 
tions, his  abilities  for  his  work,  his  training,  mental  character- 
istics, social  standing,  biases,  interests,  linguistic  habits  and  any 
other  facts  that  "  throw  light  upon  his  value  as  a  producer  of 
facts  and  discoverer  of  truth."2 

So,  as  Spahr  and  Swensen  point  out3  in  appraising  the  work  of 
other  authors  and  their  application  to  specific  marketing  studies, 
one  should  ask  many  questions.     The  following  suggests  the  kind : 

1  Spahe,  Walter  E.,  and  John  R.  Swensen,  Methods  and  Status  of 
Scientific  Research,  p.  77,  Harper  &  Brothers,  New  York,  1930. 

*  Ibid.,  p.  77. 

3  Ibid.,  p.  93. 
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'Why  did  the  author  write  the  docu- 
ment? 


Is  there  any  indication  that  facts, 
generally  accepted  as  true,  have 
been  distorted  or  presented  in  an 
unfamiliar  sense? 


Was  it  to  serve  the  truth  or  to  pro- 
mote some  special  interests — his 
own  or  those  of  some  group  or 
class?  If  the  latter,  one  must 
consider  well  the  degree  of  cred- 
ence to  give  the  whole  document. 

If  so,  the  motive  must  be  sought  and 
its  bearing  on  the  credibility  of 
the  author's  contentions  carefully 
considered. 


Was  the   author's  position   entirely 
independent? 


Is  there  any  reason  to  suspect  the 
author  of  special  pleading? 


Does  the  author  show  any  indication 
of  bias  or  prejudice  of  any  sort? 


Was  the  author  in  a  position  per- 
sonally to  observe  the  facts  he 
reports? 

Is  the  author  an  accurate  observer? 


Is  the  author  an  accurate  reporter? 


When  did  the  author  record  his  ob- 
servations? 


If  not — if  he  were  so  placed  that  his 
statements  must  necessarily  have 
been  influenced  by  factors  in  con- 
flict with  his  own  beliefs — the 
effect  of  such  pressure  must  be 
measured  as  closely  as  possible. 

If  he  were  writing  for  personal  pro- 
motion or  to  curry  favor  with 
superiors,  his  work  must  be  scru- 
tinized with  great  care. 

For  a  correct  appraisal  of  an  author's 
work  something  should  be  learned 
about  his  convictions  on  such  sub- 
jects as  theology,  religion,  politics, 
social  distinctions,  patriotism — 
any  one  of  which  might  seriously 
affect  his  expressed  attitude. 

If  not,  his  statements  must  be  re- 
garded more  or  less  as  hearsay 
evidence. 

Some  knowledge  of  the  author's  pre- 
vious work  should  indicate  his 
reliability  as  an  observer. 

The  author's  previous  work  should 
also  indicate  whether  or  not  he  has 
a  faculty  for  recounting  facts  and 
situations  with  precision. 

If  promptly,  they  would  obviously 
have  a  higher  value  than  if  re- 
corded long  after  the  observation. 
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Are  the  facts  of  such  character  as  Is  the  author  being  influenced  by- 
could  be  learned  by  observation  appearances  or  has  he  carried  his 
a|one?  investigations  far  enough  to  con- 

firm his  observations? 

Certainly,  the  research  person  should  have  complete  faith  in 
the  data  he  draws  from  bibliographical  sources  before  using  them 
in  any  marketing  research  work. 

Somewhat  akin  to  the  bibliographical  sources  of  external  data, 
are  the  records  and  reports  of  local  chambers  of  commerce 
throughout  the  country,  federal  and  state  governmental  agencies, 
universities,  colleges  and  other  institutions  and  the  circulation 
studies  of  magazines  and  newspapers.  The  general  subject  of 
sources  will  be  found  amplified  in  Chap.  V. 

Determine  How  Facts  Are  to  Be  Found 
At  this  point  in  the   " Analysis  of  the  Problem"  it  should 
be  fairly  clear  what  facts  are  necessary  for  a  solution  and  where 
those  facts  may  be  found.     An  examination  should  now  be  made 
as  to  how  the  required  facts  may  be  found. 

By  Direct  Investigation.  This  is  a  method  of  procuring  data 
from  sources  immediately  available  to  the  investigator  and  his 
own  staff.  It  excludes  all  such  data  as  rest  upon  the  stated 
opinions,  experiences  and  reactions  of  other  persons.  These 
latter  types  of  data  are  otherwise  classified.  Direct  investiga- 
tion may  be  applied  to  records  existing  in  a  business  or  to  planned 
and  systematic  observation. 

records.  The  examination  of  a  company's  sales-control 
system,  for  instance,  is  an  example  of  direct  investigation. 
In  the  absence  of  a  formal. sales-control  plan,  this  method  would 
be  directed  to  whatever  records  may  be  available  to  show  the 
company's  sales  activities  and  it  would  take  the  form  of  a  tabula- 
tion and  study  of  all  data  significant  to  the  issue. 

In  this  sort  of  an  examination,  data  may  be  extracted  to  deter- 
mine such  matters  as :  where  each  salesman  stands  in  the  matter 
of  distribution,  as  measured  by  the  percentage  of  his  customers 
being  sold  each  of  the  firm's  products ;  how  many  calls  each  sales- 
man makes  to  effect  one  sale;  the  size  of  the  orders  sold;  with 
what  regularity  each  customer  is  being  held  to  a  consistent 
repeat  record  on  each  product  once  introduced  into  his  store  or 
into  a  home. 
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In  the  same  manner  data  could  also  be  drawn  from  the  records 
to  show  the  quality  of  the  sales  direction;  to  indicate  the  degree 
of  sales  pressure  exerted;  or  to  determine  the  skill  of  the  firm's 
sales  strategy. 

Another  form  of  direct  investigation,  requiring  records,  of 
course,  might  be  called  experimental.  This  is  the  method  being 
used  by  companies  that  maintain  experimental  retail  stores  to 
try  out  new  advertising  and  sales  ideas;  to  test  window  displays; 
to  determine  the  factors  involved  in  the  selection  of  locations. 
The  comparatively  recent  idea  of  using  testing  devices,  like  the 
audimeter,  for  recording  the  number  of  listeners  on  a  radio 
program,  is  of  this  type  of  direct  investigation. 

Extensive  "exploratory"  researches,  like  the  Louisville  Grocery 
Survey1  and  the  National  Drug  Store  Survey,2  represent  studies 
by  direct  investigation.  In  these  cases  the  government  developed 
its  data  not  upon  the  stated  opinions  or  experiences  of  the  dealers, 
but  rather  upon  current  records  kept  largely  under  research 
control. 

observation.  This  is  the  second  type  of  direct  inquiry. 
An  example  of  this  sort  of  study  would  be  a  check  of  delivery 
trucks  in  a  time  study  designed  to  reduce  the  cost  of  delivery  for 
a  department  store.  Another  example  would  be  the  deliberate 
impressions  a  research  worker  reports  of  the  physical  condition 
of  stores  called  upon,  where  such  impressions  are  an  element 
of  the  study  and  where  stipulations  have  been  set  up  to  hold 
the  observations  to  some  recognized  standards. 

Data  of  this  type  must  at  some  point  be  recorded.  They 
could  not  be  studied  otherwise.  But  in  these  cases  the  record 
is  made,  as  it  were,  direct  from  the  observation  and,  therefore, 
differs  from  the  official  records  of  a  business  referred  to  under 
the  foregoing  heading.  These  data  are  transmitted  immediately 
by  the  observer  himself  without  the  intervention  of  others. 

When  the  data  obtainable  by  direct  investigation  are  not 
sufficient  to  solve  the  problem  or  are  not  germane,  resort  must 
be  had  to  a  more  complex  method  of  collecting  data.  Under 
this  method,  information  is  enlisted'  from  a  comparatively  large 

1  Louisville  Grocery  Survey,  Bureau  of  Foreign  and  Domestic  Commerce 
(Department  of  Commerce),  Washington,  D.C. 

2  National  Drug  Store  Survey,  Bureau  of  Foreign  and  Domestic  Commerce 
(Department  of  Commerce),  Washington,  D.C. 
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number  of  persons  through  the  medium  of  a  mailed  question- 
naire, by  telephone  inquiry  or  by  individual  solicitation. 

Mailed  Questionnaires.  This  method  of  fact  gathering  will 
be  discussed  more  fully  in  Chap.  VII  dealing  with  the  Collection 
of  Data.  In  general  it  may  be  described  as  an  attempt  to  extract 
data  from  a  large  field  by  mailing  to  a  predetermined  number  and 
class  of  persons  a  questionnaire  to  be  filled  out  and  returned. 

Telephone  Inquiry.  This  is  a  method  which  has  grown  rapidly 
in  recent  years  because  of  its  suitability  for  radio  surveys.  It 
consists  merely  in  telephoning  to  a  number  of  homes  with  a  brief 
questionnaire  designed  to  draw  out  the  required  information. 

This  method  may  be  utilized,  of  course,  for  types  of  study 
other  than  radio  surveys,  especially  where  the  field  is  local, 
where  the  subject  matter  lends  itself  to  discussion  on  the  tele- 
phone and  where  the  saving  in  cost,  as  compared  with  personal 
interviews,  compensates  for  a  lesser  degree  of  certainty. 

Personal  Interviews.  Under  this  process  a  number  of  field 
workers  or  reporters  are  routed  through  the  area  under  study 
with  a  prepared  questionnaire  on  which  they  are  to  report  the 
results  of  a  number  of  individual  interviews. 

While  this  is  sometimes  a  costly  method  of  assembling  data, 
it  is  generally  regarded  as  the  most  effective.  To  some  extent 
the  interviewer  can  control  the  situation,  he  can  make  clear 
the  meaning  of  doubtful  questions,  avoid  misunderstandings 
and  secure  the  most  representative  replies  in  fullness  and  accuracy. 
Another  advantage  of  the  personal  solicitation  method  is  that 
during  the  interviews  the  trained  and  competent  investigator  is 
receiving  impressions  quite  apart  from  the  answers  to  the  ques- 
tions These  impressions,  conscientiously  reported,  throw  many 
valuable  side  lights  on  all  the  specific  data  procured  in  the  course 

of  the  survey. 

As  this  treatise  progresses,  a  great  deal  will  be  said  on  the  sub- 
ject of  collecting  data  by  personal  interview.  It  involves  an 
extensive  technique,  which  will  be  found  fully  developed  in 
separate  chapters.  For  the  purpose  of  analyzing  the  problem, 
it  is  mentioned  here  only  as  one  of  the  several  survey  methods 
which  must  be  fully  considered. 

The  researcher,  having  subjected  his  problem  to  analysis  in 
the  light  of  the  foregoing  discussion,  should  have  arrived  at  the 
following  position: 


ANALYSIS  OF  THE  PROBLEM  33 

1.  He  should  have  defined  the  ultimate  objectives — comprehending  clearly 
the  uses  to  which  the  results  of  his  study  are  to  be  put. 

2.  He  should  have  identified  the  immediate  objectives  of  the  several  phases 
of  the  study  and,  to  form  an  estimate  of  the  cost,  he  must  have  deter- 
mined the  scope,  or  how  far  the  study  should  extend. 

3.  He  must  have  determined  just  what  sort  of  facts  he  will  require  for  the 
solution  of  his  problem. 

4.  He  should  have  reached  some  decision  as  to  where  he  should  search  for 
the  required  facts.     And — 

5.  He  must  have  settled  upon  the  means  he  should  take  in  the  develop- 
ment of  his  study — how  he  intends  to  get  the  facts. 

The  subject  of  planning  is  next  to  be  considered. 


CHAPTER  II 
PLANNING  OF  PROCEDURE 

(As  Presented  in  Chart  D) 

Too  much  stress  cannot  be  laid  upon  planning  as  an  element 
in  sound  and  efficient  marketing  research.  In  the  process  of 
Analyzing  the  Problem,  as  described  in  the  preceding  chapter, 
it  is  probable  that  the  experienced  research  director  will  have 
arrived  at  some  general  conclusions  as  to  the  procedure  he  should 
follow.  Such  a  person  may  seem  to  pass  from  the  stage  of  analy- 
sis to  that  of  execution  with  little  regard  for  formal  planning. 

It  should  not  be  assumed,  however,  that  even  the  most 
experienced  research  director  ever  fails  to  plan,  and  to  plan  care- 
fully. Not  only  must  the  structure  of  his  work  follow  more  or 
less  closely  the  "Steps"  outlined  in  the  accompanying  charts; 
but,  in  the  larger  studies,  there  is  also  to  be  considered  the  impor- 
tant element  of  timing. 

In  an  extensive  study,  all  the  steps  and  all  the  action  described 
in  this  treatise  may  be  called  into  play.  Many  of  the  parts  will 
overlap,  some  will  dovetail  with  others  and  a  few,  perhaps,  will 
run  simultaneously  in  divers  directions.  If  such  a  study  is  to 
proceed  smoothly  and  economically,  all  its  activities  must  be  so 
scheduled  as  to  bring  each  phase  of  the  work  to  completion  at 
the  most  effectual  juncture.  Not  logically  could  such  coordina- 
tion be  expected  without  definite  plans,  whether  arrived  at  by 
deliberate  effort  or  by  seeming  intuition  as  a  result  of  much 
experience. 

The  chart  bearing  the  title  of  this  chapter  sets  forth  the  salient 
points  of  the  planning  process  in  approximately  the  sequence  in 
which  they  should  be  considered  at  the  opening  of  any  compre- 
hensive marketing  study.  All  of  these  points  must  necessarily 
recur  in  connection  with  the  execution  of  the  plans  and  at 
appropriate  places  each  point  will  be  treated  in  adequate  detail. 
They  are  presented  here  principally  to  stress  the  imperative 
need  for  careful  and  thorough  planning;  to  afford  a  sort  of  inven- 
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tory  of  what  should  be  planned  and,  in  very  general  terms,  to 
describe  or  define  the  points  as  a  prelude  to  their  more  complete 
discussion  in  subsequent  chapters. 

Determine  Operating  Plans 
Operating  plans  must  necessarily  differ  as  the  types  of  study 
differ.  As  has  been  shown,  there  are  four  basic  methods  of  find- 
ing the  facts  required  in  a  marketing  study— by  direct  investiga- 
tion, by  mail,  by  telephone  and  by  personal  solicitation.  Each 
of  these  entails,  of  course,  its  own  technique  and  the  several 
types  advance  in  complexity  as  they  proceed  from  the  individual 
study  of  recorded  data  to  the  organized,  or  group,  expedition 
into  the  almost  limitless  field  of  unrecorded  data. 

In  planning  for  a  study  of  such  breadth  and  intricacy,  con- 
sideration must  be  given  to  the  whole  range  of  technique.  Practi- 
cally all  the  features  of  any  of  the  other  kinds  of  marketing 
research  enter  intoHhe  planning  of  the  most  advanced  type.  For 
that  reason  this  discussion  will,  while  touching  all  four  of  the 
basic  methods,  treat  with  special  regard  the  more  elaborate 
operations. 

Forms.  Since  the  purpose  of  marketing  research  is  to  assemble 
a  mass  of  related  data  and  set  them  up  effectively  for  study,  it 
is  inevitable  that  forms  of  some  sort  will  be  required.  The  num- 
ber of  forms,  their  types  and  scope  are,  of  course,  dependent 
upon  the  character  of  the  specific  study;  but,  whatever  the  forms 
are  to  be,  they  should  all  be  carefully  and  fully  thought  out  in 
advance  to  insure  the  smooth  execution  of  the  work. 

questionnaire.  Generally  speaking,  the  first  form  in  the 
usual  sequence  is  the  schedule  of  questions.  The  popular  under- 
standing of  a  questionnaire  is  a  series  of  questions  to  be  addressed 
to  others  for  formal  answer.  Actually,  however,  its  meaning  is 
broader  than  that.  It  represents  also  those  questions  which  the 
research  director  must  ask  himself  as  a  means  of  discovering  the 
truth  concerning  the  subject  of  his  study. 

Even  so  simple  a  problem  as  "How  do  our  sales  this  year 
compare  with  last  year?"  involves  a  questionnaire.^  The 
researcher  must  address  to  himself  at  least  two  questions:  "What 
ivere  the  sales  last  year?"  and  "What  are  the  sales  this  year?^" 
He  might  get  the  answers  in  a  single  reference  to  the  firm's 
ledgers  but  to  give  such  an  inquiry  the  dignity  of  "research" 
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he  should  have  to  address  those  two  questions  to  himself  with 
respect  to  each  individual  salesman,  each  state,  county,  city  or 
sales  district;  again,  with  respect  to  each  product  or  class  of 
products  and,  perhaps,  still  again,  with  respect  to  some  classifica- 
tions of  profit  margin,  sales  cost  or  other  significant  feature. 
The  inquiry  broadens;  but  underlying  the  whole  process  is 
the  questionnaire — only  two  questions,  but  a  questionnaire, 
nevertheless. 

The  point  of  this  definition  is  that  whether  the  problem  be 
simple  or  complex,  whether  it  involve  an  individual  personal 
effort  or  a  wide-flung  inquiry  over  a  national  field,  whether  it 
be  addressed  to  oneself  or  to  others,  a  questionnaire  of  some  sort 
will  be  required  and  must  be  planned  in  advance. 

In  planning  a  questionnaire,  many  factors  must  be  taken  into 
account,  depending  upon  the  kind  of  study  it  is  to  be. 

In  a  study  "by  direct  investigation,"  for  instance,  little  may 
be  necessary  in  the  way  of  a  questionnaire.  A  single  question  or 
any  simple  list  will  suffice,  if  it  serves  effectively  to  focus  the 
mind  of  the  researcher  on  the  specific  data  required;  if  it  tends 
fully  and  clearly  to  reveal  those  data  and  if  it  holds  the  researcher 
steadily  to  the  purpose. 

Some  of  these  direct  investigations,  however,  may  present  a 
number  of  ramifications.  They  may  entail  a  study  of  records  or  a 
series  of  observations  or  a  combination  of  the  two  processes.  And 
frequently  they  have  to  be  coordinated  with  a  field  survey 
designed  to  support  or  qualify  the  results  of  the  internal  study. 

As  an  example  of  such  a  problem,  let  us  suppose  that  a  certain 
manufacturer  has  a  serious  problem.  He  is  operating  in  a  highly 
competitive  field.  He  has  large  capital,  a  well-established 
production  and  sales  organization  and  one  of  the  best  plants  in 
the  country  as  to  equipment  and  capacity.  His  goods  are 
uniformly  regarded  as  of  the  highest  quality.  To  a  marked 
degree  this  manufacturer  has  all  the  obvious  elements  of  a 
successful  business.  His  problem  is  that  he  does  not  thrive  in 
his  own  natural  market,  the  city  in  which  his  plant  is  located.  It 
is  a  big  market  and  it  has  grown  in  population  and  buying  power 
much  faster  than  the  average  for  the  nation,  yet  he  is  no  farther 
ahead  now  than  he  was  ten  years  ago.  He  feels  that  something 
must  be  wrong  with  his  marketing  setup  or  process.  He  wants 
to  know  what  it  is,  why  it  is  so  and  how  to  rectify  it. 
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Situations  of  this  sort  are  rarely  the  result  of  any  single  cause. 
Usually,  they  grow  gradually  out  of  a  combination  of  circum- 
stances.' Before  a  correction  can  be  effected,  the  causal  cir- 
cumstances must  first  be  identified;  and  then,  each  separate 
weakness  must  be  offset  by  some  specific  remedial  action.  It  is 
to  find  the  difficulties,  through  the  medium  of  study,  that  ques- 
tionnaires become  necessary.  At  this  point,  however,  the 
discussion  is  concerned  only  with  the  kind  of  questionnaire 
required  for  that  part  of  a  study  which  involves  "direct  investiga- 
tion." It  comprises  those  questions  which  the  investigator, 
must  address  to  himself,  as  it  were,  before  searching  the  records 

for  his  answers. 

The  general  fields  of  investigation  to  be  examined  for  a  lull 
study  in  this  hypothetical  case  would  be  the  four  basic  categories 
referred  to  on  pages  21  and  24.  The  subject  of  planning  will 
here  be  considered,  however,  only  in  connection  with  the  investi- 
gation of  one  field— the  company's  "methods  and  means"  of 
marketing.  This  will  indicate  what  similar  planning  is  required 
for  direct  investigation  in  the  other  fields. 

The  following,  then,  would  be  the  major  factors  to  be  taken  into 
consideration  with  respect  to  the  company's  selling  process: 

1  A  variety  of  products.  Products  known  to  meet  all  the  competitive 
requirements  of  that  market  in  quality,  price,  style,  variety  and  other 
such  intrinsic  features. 

2  A  market  in  which  to  sell.  The  market  comprising  the  thousands  of 
outlets  in  the  manufacturer's  own  city  eminently  suited  for  the  sale  ot 
of  the  company's  products  but  leaning  heavily  to  a  competitor. 

3.  A  staff  of  salesmen,  comprising  in  the  local  market,  say,  twenty-five 
men  of  average  experience  and  capacity. 

4.  A  system  of   supervision,   represented  by   crew  managers— perhaps 

three  of  them.  .  , 

5.  A  local  sales  manager,  his  equipment  of  intelligence,  aggressiveness  and 

leadership.  m  .       , 

6.  A  general  sales  manager,  his  personal  equipment  and  his  faculty  for 

administration. 

Underlying  these  various  considerations,  the  four  basic  cate- 
gories of  possible  difficulties  are  clearly  distinguishable.  Even 
though  the  investigation  is  limited  to  one  category,  it  must 
obviously  comprehend  each  of  the  others-so  far  as  they  relate 
to  the  selling  operation.  This  is  necessarily  true,  because  there 
can  be  no  foreknowledge  as  to  just  where  retarding  influences 
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are  to  be  found  or  as  to  just  what  weaknesses  each  of  these 
categories  may  be  contributing  to  the  unfavorable  situation 
being  investigated. 

In  practice,  the  reasoning  up  to  this  point  should  properly 
be  carried  through  during  the  period  of  Analyzing  the  Problem. 
It  is  introduced  here  simply  to  build  a  background  for  a  discus- 
sion of  the  kind  of  questionnaire  to  be  planned  in  a  direct  investi- 
gation of  the  more  complicated  sort. 

This  discussion  is  intended  to  suggest  the  kind  of  questions 
that  might  be  included  in  the  schedule  for  this  present  example ; 
to  indicate  briefly  what  each  question  or  group  of  questions  may 
be  expected  to  show  and  to  outline  in  general  terms  what  con- 
structive conclusions  might  be  deduced  from  the  returns.  There 
are  several  reasons  for  such  an  elaboration  at  just  this  point. 

A  study  by  direct  investigation,  as  has  been  pointed  out  in 
Chap.  I  (page  30)  is  distinguished  by  the  circumstance  that  it 
is  based  upon  the  findings  of  the  investigator  himself  and  his  own 
staff  and  that  it  excludes  the  three  other  processes — processes 
which  rest  upon  opinions,  experiences  and  reactions  stated  by 
persons  other  than  the  investigator.  The  planning  is,  there- 
fore, more  or  less  personal  with  the  investigator;  it  is  not  some- 
thing worked  out  in  an  office  and  executed  elsewhere  and  by 
other  persons;  nor,  usually,  is  there  any  considerable  interval 
of  time  between  the  planning  and  the  execution.  In  this  sort  of 
study  planning  is  the  essence;  the  collection  of  the  data  is  largely 
a  clerical  affair,  even  when  done  by  the  investigator  in  person. 
For  these  reasons  we  shall  consider  here  in  detail  the  questions 
suggested  by  the  factors  in  this  hypothetical  problem. 

In  connection  with  the  first  major  factor,  then,  the  "variety 
of  products,"  and  bearing  in  mind  that  only  the  " selling  process" 
is  being  studied,  the  principal  question  for  a  direct  investigation 
would  probably  be : 

1.  How  many  units  of  each  product  were  sold  in  the  affected  area  during 
each  month  of  the  preceding  fiscal  year? 

The  tabulated  reply  to  this  question  would  show  the  flow  of 
goods  through  the  plant  and  into  consumption  and  it  would 
identify  the  items  which  tended  to  hold  back  the  stream  in  each 
month.  Now,  if  an  external  survey— a  study  of  conditions  out 
in  the  field — were  in  progress  at  the  same  time,  as  should  be  the 
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case,  the  returns  from  the  direct  investigation  could  readily  be 
checked  against  what  the  field  study  shows  to  be  the  month-to- 
month,  or  seasonal,  requirements  for  each  product.  The  deduc- 
tion to  be  drawn  is  that  the  company  is  or  is  not  timing  its  sales 
emphasis  on  each  product  in  harmony  with  its  best  opportunity. 
If  it  is  not,  then  one  retarding  factor  has  been  identified  which 
must  be  removed.  u 

In  connection  with  the  second  major  factor,  the  market  in 
which  to  sell,"  the  principal  question  in  a  direct  investigation 
would  probably  be : 

2.  How  many  units  of  each  product  were  sold  within  the  year  in  each 
sales  territory  or  subdivision  of  the  affected  area— the  dollar  volume, 
the  cost  of  selling,  the  profit  yield? 

These  data  would  disclose  the  weak  territories  on  each  product. 
They  should  be  checked,  as  to  each  product,  with  what  is  shown 
by  the  field  survey  to  be  the  sales  potential  in  each  territory  as 
determined  by  population,  race,  buying  power— both  the  ability 
and  the  mood  to  spend— the  number  and  class  of  outlets  in  the 
manufacturer's  home  market,  competitive  conditions  and  other 
such  indices.  The  deductions  to  be  drawn  here  have  to  do  with 
the  relation  between  performance  and  potentialities. 

Potentialities  cannot  be  measured  with  absolute  precision, 
but  they  can  approximate  reality  closely  enough  for  practical 
purposes.  If,  then,  in  this  hypothetical  case,  performance  with 
respect  to  any  product  should  be  found  too  far  below  the  potential, 
another  retarding  factor  will  have  been  found  which  should  be 
removed  by  special  attention.  It  is  conceivable,  too,  that  all 
the  products  may  be  in  default. 

In  connection  with  the  third  factor,  the  "staff  of  salesmen," 
there  would  probably  be  a  number  of  questions  such  as: 

3.  To  how  many  outlets  in  the  market  being  studied  does  each  salesman 
sell  each  product? 

4.  What  percentage  of  each  salesman's  customer  list  does  the  above 
figure  represent — on  each  product? 

5.  How  many  customers  has  each  salesman  sold  once  in  the  year,  twice  in 
the  year,  three  times,  etc.? 

6.  To  how  many  customers  has  each  salesman  sold  one  product?     To  how 
many  has  he  sold  two  products,  three  products,  etc.? 

Questions  of  this  sort  tend  to  disclose  how  the  salesmen 
stand  with  respect  to  the  distribution  and  repeat  record  they 
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achieve  on  each  product.  These  data  should  be  checked  against 
some  norm — represented,  perhaps,  by  a  performance  somewhat 
above  the  average  on  each  product. 

This  should  be  one  of  the  most  fruitful  lines  of  investigation. 
It  should  not  only  show  where  each  salesman  stands  on  every 
feature  of  his  sales  work  but  it  should  also  provide  a  means  of 
establishing  a  par  by  which  each  man's  value  to  the  company 
can  be  measured  at  all  times.  In  such  situations  as  we  are  now 
considering,  it  is  usually  in  connection  with  the  detailed  field 
work  that  most  of  the  difficulty  is  found.  But,  curiously  enough, 
the  fault,  except  in  individual  cases,  lies  most  often  in  manage- 
ment— as  in  the  instance  referred  to  in  connection  with  repeat 
sales  on  page  26. 

In  connection  with  the  fourth  factor,  the  "system  of  super- 
vision," the  questions  might  be: 

7.  How  regularly  is  each  customer  called  upon? 

8.  How  many  calls  are  made  per  sale  consummated? 

9.  What  is  the  average  sale  in  dollar  volume? 

10.  What  is  the  average  standing  of  the  men  in  each  supervisor's  territory 
— as  to  coverage,  distribution  of  products,  repeat  business,  dollar 
volume,  number  of  sales,  cost  of  sales? 

Tabulations  built  upon  questions  of  this  sort  tend  to  show — 
through  the  records — the  quality  and  the  constancy  of  the  super- 
vision in  the  field.  All  of  the  data  resulting  from  such  questions 
should  be  checked  against  standards  built  up  out  of  the  perform- 
ance of  the  individual  salesmen  and  crews.  The  deductions  from 
such  data  would  indicate  the  force  and  intelligence  applied  by 
supervisors  in  holding  their  men  steadily  to  some  definite  and 
calculated  field  procedure.  Departures  from  such  standards 
would  represent  weaknesses  to  be  corrected. 

In  connection  with  the  fifth  factor,  the  "local  sales  manager," 
the  questions  might  run  along  these  lines: 

11.  What  is  the  relative  cost  for  each  salesman  per  dollar  of  sales? 

12.  What  is  the  credit  loss,  if  any,  per  salesman— what  per  cent  of  sales? 

13.  To  what  extent  are  new  sales  retarded  by  uncollected  bills? 

14.  If  "deals"  are  encouraged,  can  it  be  discerned  in  the  record  whether 
sales  are  retarded  either  by  distracting  the  salesman  from  the  other 
products  or  by  overloading  customers? 

15.  What  is  the  turnover  in  man  power — and  what  does  it  cost? 
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Questions  of  this  sort  tend  to  indicate  the  sales  manager's 
awareness  of  his  job,  which  is,  to  effect  the  maximum  of  sales 
in  that  market  at  the  maximum  profit  to  his  company.  II  by 
any  standard  it  could  be  said  that  maximum  sales  or  maximum 
profits  were  not  being  achieved,  the  data  resulting  from  such  a 
questionnaire  would  point  definitely  to  the  adjustment  which 

should  be  made. 

The  sixth  factor,  the  "general  sales  manager,"  is  here  considered 
as  embodying  the  administrative  authority  of  the  business. 
Direct  investigation  into  this  factor  would  suggest  such  questions 
as  these: 

16  Are  territorial  sales  forecast— are  costs  budgeted? 

17  What  is  the  relation  of  performance  to  forecast— to  budget  t 

18  Is  the  company's  attitude  urgent  with  respect  to  sales  and  profits/ 
19'.  Does  it  insist  upon  holding  trade  once  won  or  does  it  tolerate  a  heavy 

customer  turnover?  m 

20.  Does  it  recognize  true  repeat  business  to  be  not  simply  fbe  nappwv 
ance  of  a  given  name  occasionally  on  the  customer  ledger  but  rather 
a  buyer's  consistent  purchase-at  regular  and  logical  mtervals-of 
every  product  once  introduced  into  his  store? 

21.  Is  the  company's  compensation  policy  calculated  to  produce  the  best 
results? 

These  questions  have  to  do  with  policies  of  administration. 
They  serve  to  reveal  clearly  the  purpose,  the  character,  the 
astuteness  of  the  company's  management,  its  attention  to 
significant  details  and  the  determination  with  which  it  forces 
progress.  The  deductions  to  be  drawn  from  these  data  are 
whether  or  not  the  administration  of  the  business  is  fu  filling 
its  purpose,  in  what  particular  and  to  what  degree  it  fails  and 
the  effect  of  its  failure  on  the  company's  welfare. 

These  are  certainly  not  all  the  questions,  nor  conceivably 
the  best,  which  might  be  addressed  to  each  of  these  factors 
in  such  a  study  as  is  being  here  visualized.  Nevertheless  answers 
to  such  questions  as  these,  procured  by  "direct  investigation 
of  records  and  by  observation  within  the  affected  area,  inter- 
preted in  conjunction  with  data  from  the  field,  represent  the 
appropriate  process  of  research  in  such  situations. 

This  subject  of  planning  a  direct  investigation  may  seem  to 
have  been  treated  at  unnecessary  length.  Some  may  feel,  too, 
that  these  aspects  of  the  subject  are  concerned '  with  marketing 
in  general  rather  than  with  research.     It  should  be  clear,  how- 
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ever,  that  before  any  marketing  principles  can  be  applied  to 
such  a  problem  as  has  been  here  discussed,  a  research  precisely 
along  these  lines  must  be  carried  through. 

With  regard  to  the  procedure  for  the  three  other  methods  of 
collecting  data,  attention  shall  be  confined  here  strictly  to  the 
stage  of  Planning.  Because  these  other  methods  involve  the 
experiences,  reactions  and  opinions  of  numbers  of  people,  they 
require  special  and  often  complicated  techniques,  which  are  fully 
treated  in  chapters  to  follow. 

A  study  "by  mailcQiejstwnn^  requires  considerable  care. 
There  are  definite  limitations  to  the  kind,  amount  and  reliability 
of  information  which  can  be  obtained  by  mail.  These  limita- 
tions arise  largely  from  the  fact  that  the  respondent  is  entirely 
on  his  own  as  to  what  and  how  he  shall  answer.  There  is  no 
interviewer  present  in  person  to  direct  his  mind  to  each  question, 
to  explain  away  possible  doubts  or  to  draw  out  impressions, 
opinions  and  experiences  by  adroit  use  of  subordinate  or  "  specify- 
ing" questions.  In  preparing  a  questionnaire  for  such  use, 
therefore,  every  precaution  must  be  taken  to  the  end  that  each 
question  shall  be  crystal  clear;  that  it  may  be  easily  and  uni- 
formly understood  and  that  it  may  be  answered  simply  and 
definitely. 

Notwithstanding  its  recognized  weaknesses,  the  mailed  ques- 
tionnaire is  too  widely  used  to  be  overlooked  entirely  in  a  discus- 
sion of  planning.  Its  reputation  for  economy  and  flexibility 
commend  it,  not  so  much  to  research  people  as  to  their  clients. 
It  is  regarded  as  economical  because  it  involves  no  more  than 
printing  and  mailing  the  questionnaire  and  flexible  because  it  can 
readily  be  directed  to  any  territory  or  class  of  respondents, 
however  large  and  however  widespread.  Sometimes,  even  the 
two-way  mailing  can  be  avoided — as  when  a  magazine  encloses  a 
questionnaire  in  an  issue  of  its  publication. 

In  Chap.  VII  (on  pages  87-88)  there  is  presented  some  discus- 
sion of  the  disadvantages  of  surveys  conducted  by  mail.  Gen- 
erally speaking,  these  are:  The  problem  of  preparing  a  suitable 
questionnaire;  the  difficulty  of  distributing  it  in  such  a  way  as 
most  surely  to  reach  the  classes  of  people  desired;  the  uncer- 
tainty of  control  as  to  the  conditions  in  the  field  and  the  impossi- 
bility of  predetermining,  as  to  number  and  type,  the  ratio  of 
respondents  to  the  field  as  a  whole. 
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A  study  "by  telephone  inquiry"  also  requires  a  questionnaire. 
In  this  case,  however,  it  is  obvious  that  the  scope  of  the  question- 
naire is  restricted  by  a  time  factor.  The  number  of  questions 
that  can  reasonably  be  asked  over  a  telephone  is  limited  and 
they  must  be  fairly  explicit. 

The  telephone  inquiry  is  being  used  generally  and  in  a  large 
way  to  ascertain  the  number  of  listeners  to  radio  programs. 
In  one  inquiry,  made  during  1935,  forty  operators  were  used  to 
ask  the  questions,  while  a  corps  of  clerks  got  the  numbers  for 
them.  So  few  questions  were  asked,  and  these  so  simply,  that 
in  the  course  of  the  thirty-minute  program  many  hundreds  of 
interviews  were  held.  Some  further  details  of  this  subject  will 
also  be  presented  in  Chap.  VII. 

A  study  "by  multiple  personal  interviews"  may  be  said 
generally  to  permit  a  fairly  elaborate  questionnaire;  because, 
however  long  or  involved  it  may  be,  its  way  can  be  smoothed 
considerably  by  the  personal  art  or  skill  of  the  interviewer. 

In  detail,  the  factors  underlying  a  questionnaire  for  multiple 
personal  interviews  will  be  discussed  from  the  psychological  point 
of  view  in  the  chapter  following  this  and  again  in  connection  with 
practice  in  Chap.  VII.  As  a  matter  of  planning^  however,  all 
the  factors  revolve  around  the  following  basic  considerations: 

The  Purpose  of  the  Study.  As  to  the  specific  facts  or  informa- 
tion being  sought.  That  is  to  say,  we  must  assuredly  plan  to 
bring  out  the  particular  facts  needed  to  solve  the  problem. 

How  the  Questions  Are  to  Be  Addressed.  By  direct  reference 
to  records,  by  mail,  by  phone,  or  by  personal  interview.  This 
is  to  say  that  the  questions  must  be  built  specifically  to  accord 
with  the  method  by  which  the  respondents  are  to  be  approached. 

To  Whom  Addressed.  As  to  sex,  age,  occupation,  race,  social 
or  economic  position,  known  interests  or  other  circumstances 
which  might  affect  the  phrasing  or  the  intent  of  the  questions 

asked. 

The  Opportunity  for  Questioning.  As  to  the  time  available, 
the  place,  convenience  or  other  circumstances  under  which  the 
questions  must  be  asked  and  which  might  affect  their  scope. 

Who  Is  to  Ask  the  Question.  As  to  the  interviewer's  age,  sex, 
tact,  intellectual  equipment,  observational  powers,  detachment 
or  other  personal  characteristics  which  might  affect  the  fullness 
or  the  accuracy  of  the  replies. 
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These  various  considerations  underlie  not  only  the  order  and 
the  phrasing  of  the  questions  but  also  their  character — as  to 
whether  they  should  be  categorical,  or  general;  factual  or  hypo- 
thetical; whether  they  should  be  directed  toward  the  addressee's 
memory,  his  present  experience  or  his  opinions;  or  perhaps, 
whether  they  should,  in  any  particulars,  call  upon  the  observa- 
tional faculties  of  the  interviewer.  These  same  considerations 
also  affect  the  physical  features  of  the  questionnaire — its  size, 
shape,  make-up. 

In  preparing  the  questionnaire,  it  is  always  necessary  to  deter- 
mine in  advance  whether  the  tabulating  of  the  reports  is  to  be 
done  by  hand  or  by  machine.  In  the  course  of  this  treatise  both 
methods  of  tabulation  will  be  discussed  in  detail  and  the  reasons 
for  predetermining  this  point  made  clear. 

other  forms:  The  purpose  of  the  questionnaire  is  to  procure 
data,  the  common  "raw  material' '  of  all  research.  The  next 
step  is  to  plan  the  forms  necessary  for  the  organization  and  use 
of  those  data.  For  this  purpose  the  two  forms  customarily  used 
are  the1  tabulation  form  and  the  work  sheet.  In  practice  and  for 
a  specific  job  it  is  conceivable  that  other  forms  may  have  to  be 
^Trrrpro vised  for  special  purposes  but  these  two  are  more  or  less 
essential  to  most  studies. 

The  terms  "tabulation  form"  and  "work  sheet"  are  rather 
indefinite.  Often  they  are  used  interchangeably.  The  tabula- 
tion form  is  frequently  used  as  an  intermediate  step  in  the 
process  of  organizing  data,  the  results  of  the  separate  tabulation 
forms  being  transferred  to  an  assembly  or  work  sheet.  In  other 
cases  the  tabulation  form  is  omitted;  in  these  instances  the  replies 
are  posted  directly  from  the  completed  questionnaires  to 
columnar  work  sheets— only  the  totals  being  brought  over  to  a 
final  assembly  sheet.  Samples  of  these  forms  with  adequate 
explanations  will  be  found  in  Chap.  XII. 

Since  the  questionnaire  form,  applicable  to  studies  made  by 
"direct  investigation,"  has  been  discussed  in  considerable  detail 
in  this  chapter,  it  seems  expedient  for  the  same  reasons  to  say  a 
word  or  two  about  the  tabulation  forms  and  assembly  sheets 
which  might  be  employed  in  the  direct  type  of  research. 

The  form  in  most  common  use  is  probably  the  columnar  sheet, 
the  columns  being  used  for  one  factor  and  the  horizontal  lines  for 
another  related  to  it.     Consider,  for  example,  the  first  question 


46 


THE  TECHNIQUE  OF  MARKETING  RESEARCH 


presented  on  page  39 —  "How  many  units  of  each  product  were 
sold  in  each  month  1  .  .  ?"  In  tabulating  the  results  of  this 
question,  the  various  products  would  be  designated  down  the 
left-hand  margin  of  the  sheet  and  the  months  of  the  year  across 
the  top. 

When  a  number  of  questions  are  involved,  separate  sheets 
may  be  needed  to  cover  each  pair  of  related  factors;  but  when  one 


SALESMAN  jhr^rv  <&-*< 


i  In  the  number  of  periods  shown  in  Table  A 


2  The  number  of  customers  being  sold  the  designated 
number  of  products,  multiplied  by  the  number  of 
products  not  being  sold  gives  the  number  of  sales 
opportunities  lost;  if  a  dealer  is  being  sold  only  one 
out  of  twelve  products  appropriate  to  his  line,  11 
sales  opportunities  are  being  lost. 


jrIG   2. — Example  of  combination  tabulation  form. 

of  the  factors  is  to  be  examined  in  its  relation  to  several  others, 
the  stable  factor  should  be  placed  on  the  horizontal  lines  and  the 
columns  used  for  all  the  others. 

Sometimes  circumstances  require  special  forms  built  for  the 
occasion.  For  example:  In  connection  with  the  third  factor  in 
the  hypothetical  questionnaire,  referred  to  on  page  40,  there  are 
required  four  kinds  of  information  regarding  each  salesman.  A 
work  sheet  for  a  group  of  questions  of  this  sort  is  shown  in  Fig.  2. 
With  sheets  like  this  for  a  number  of  salesmen  many  interesting 
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and  constructive  comparisons  can  be  made  for  the  betterment  of  a 
firm's  marketing  effort. 

In  machine  tabulating  the  tabulation  form  has,  of  course,  a 
fixed  place  in  setting  up  a  variety  of  reflections  in  separated 
totals.  This  will  be  clearly  shown  in  Chap.  XIV,  which  treats 
exclusively  of  machine  tabulation.  The  criterion  as  to  whether 
hand  or  machine  tabulation  is  to  be  employed  is  not  solely  the 
size  of  the  study,  the  number  of  interviews  and  questions. 
Size  is  only  one  feature.  It  is  necessary  in  planning  to  consider 
the  practicability  of  each  system,  hand  and  machine,  for  the 
specific  study.  The  factors  of  speed,  accuracy,  flexibility,  con- 
venience, credibility  and  cost  should  all  be  weighed  and  all  the 
forms  adjusted  in  accordance  with  the  conclusion.  These  factors 
are  all  discussed  as  matters  of  practice  in  Chap.  XII,  beginning 
on  page  233. 

Staff.  It  is  necessary  to  consider  the  selection,  the  training 
and  the  routine  for  reporters,  supervisors,  inspectors,  editors 
and  tabulators.  Just  how  far  it  is  expedient  to  go  in  building  and 
preparing  the  staff,  of  course,  depends  upon  the  size  and  scope 
_of-tke  work  and  the  manner  in  which  it  is  to  be  conducted.  All 
these  matters  will  be  treated  in  detail  in  later  discussions  of  actual 
practice.  It  is  sufficient  here  only  to  refer  to  them  in  broad 
terms  to  indicate  their  place  and  importance  in  this  stage  of 
planning. 

If  a  study  is  to  be  made  "by  direct  investigation,"  through 
the  examination  of  records  and  by  observation,  the  scope  will 
indicate  how  many  persons  are  required  for  the  work  and  suggest 
the  type  of  person  suitable  for  it.  As  has  already  been  pointed 
out,  however,  such  studies  are  usually  made  by  a  competent 
research  man  himself,  assisted,  perhaps,  by  a  staff  closely 
associated  with  him.  In  such  cases  the  selection,  training  and 
routine  have  long  antedated  the  work  immediately  at  hand. 

In  a  study  based  upon  " mailed  questionnaires"  the  situation 
is  somewhat  similar,  except  that  if  the  tabulation  is  to  be  done 
by  hand  and  the  force  is  to  be  recruited  for  the  specific  work, 
care  must  be  exercised  in  the  selection  and  training  of  the  tabula- 
tors and  in  laying  out  their  routine  for  the  smooth  and  precise 
execution  of  the  work. 

Where  the  research  is  conducted  by  "  telephone  inquiries," 
the  planning  of  the  staff  takes  on  somewhat  greater  importance 
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because  of  the  introduction  of  an  additional  factor — the  voice. 
A  voice  suitable  for  telephone  inquiries  cannot  be  built  overnight. 
As  an  element  in  selection,  all  applicants  for  such  work  should 
be  required,  as  a  final  test,  to  telephone  in  to  the  research  office 
and  recite  several  times  the  introductory  script  and  the  questions. 
Even  with  a  good  vocal  instrument  there  is  much  to  be  taught  to 
telephone  inquirers  regarding  the  use  of  inflections  and  tones  in 
creating  confidence  in  the  mind  of  the  respondent  and  inclining 
him  or  her  to  cooperate  fully  and  cheerfully. 

Since  all  the  factors  involved  in  planning  for  a  small  or  a 
specialized  staff  are  embraced  in  a  larger  one,  the  discussion  here 
concerns  more  particularly  a  staff  designed  for  "  multiple  personal 
interviews." 

Where,  for  a  prospective  study,  there  is  an  existing  staff  already 
trained,  working  under  an  established  routine  and  ready  to  func- 
tion on  any  assignment,  the  only  planning  involved  is  that  which 
would  be  required  to  set  the  staff,  or  some  appropriate  part  of 
it,  in  motion  on  the  matter  in  hand.  A  research  agency  with  one 
or  more  retained  investigators  in  each  of  a  hundred  markets  need 
employ  only  a  small  part  of  its  organization,  for  instance,  to  make 
a  field  study  in  New  England.  That  section  of  the  organization 
is  already  trained;  all  it  needs  are  instructions  specific  to  the  study 
to  be  made. 

Where,  however,  a  newly  recruited  staff  is  required,  con- 
siderable advance  planning  must  be  done.  Suppose,  for  example, 
a  research  man  were  called  into  a  city  of  two  or  three  hundred 
thousand  population  and  asked  to  make  a  quick  but  thorough 
study  of  its  newspapers,  in  order  to  measure  their  relative  values 
as  advertising  media  in  the  homes. 

One  of  the  points  to  determine  at  once  under  these  circum- 
stances would  be,  of  course,  the  composition  of  the  staff — the 
number  of  reporters,  supervisors,  inspectors,  editors  and  tabula- 
tors. All  of  the  conclusions  on  this  point  are  dependent 
upon: 

The  Time  Available  for  the  Study.  Speed  is  usually  a  factor 
in  such  studies.  If  too  leisurely  in  execution,  one  of  the  papers 
may  release  a  hectic  circulation  campaign  and  so  inflate  the  find- 
ings with  respect  to  its  showing  as  to  destroy  the  value  of  the 
study  entirely.  The  second  and  third  papers  might  "gang  up" 
to  discredit  the  field  work,  even  while  in  progress. 
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It  would  be  necessary,  therefore,  so  to  set  the  schedules  as 
to  complete  the  field  work  in  a  few  days — before  any  obstructive 
factor  could  be  introduced. 

The  Number  of  Interviews  Projected.  When  this  figure  has 
been  arrived  at,  in  the  manner  to  be  described  later,  it  may  be 
divided  by  the  time  available — to  give  a  basic  idea  of  how  many 
completed  questionnaires  will  be  required  per  day  to  finish  the 
work  on  time. 

If  approximately  three  thousand  interviews  are  projected  and 
the  schedule  calls  for  five  days  of  field  work,  it  is  obvious  that 
the  average  daily  returns  should  be  around  six  hundred. 

The  Length,  Scope  and  Character  of  Questionnaire.  The  length 
of  time  it  takes  to  complete  one  questionnaire  indicates,  of  course, 
how  many  minutes  it  will  take  per  day  to  yield  the  600  interviews. 
If  on  tests  it  takes  ten  minutes  to  complete  a  questionnaire  and 
two  minutes  to  move  from  one  respondent  to  the  next,  five  inter- 
views could  be  completed  in  an  hour  and,  in  all,  120  work  hours 
would  be  required  to  supply  the  average  daily  returns. 

The  next  question  would  be:  "How  many  hours  of  work  per 
day  could  be  expected  from  a  field  interview  ?"  This,  in  turn, 
depends  on  several  things:  whether  the  interviewers  are  men  or 
women,  young  or  old,  whether  they  ride  or  walk,  for  instance. 
In  practice  it  seems  that  about  six  hours  of  actual  work  in  the 
field  is  about  all  that  can  be  expected  as  a  normal  performance. 

This  would  mean  that  a  staff  of  twenty  persons  would  be 
required  to  perform  120  work  hours  per  day  to  produce  600 
completed  interviews.  But  this  estimate  is  not  final;  it 
may  have  to  be  raised  or  lowered  in  accordance  with  other 
circumstances. 

The  Character  of  the  People  to  Be  Interviewed.  If  any  con- 
siderable number  of  the  respondents  are  of  the  elite,  a  much 
longer  interval  than  two  minutes  will  elapse  between  calls  and  the 
hourly  expectation  must  be  reduced.  Such  people  are  not  so 
easy  to  see  at  once.  Progress  is  also  retarded  if  the  respondents 
are  leisurely  people  or  overly  interested  and  verbose  or  just 
friendly  and  difficult  to  leave  decisively. 

On  the  other  hand,  if  a  large  section  of  the  field  were  illiterate, 
as  might  be  the  situation  among  Negroes  in  some  southern  cities, 
very  few  readers  might  be  found  in  their  districts.  The  first 
answer — "Ah  doan  neva  look  at  no  paipah,"  or  "Mister,  Ah 
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cain't  read  a  tall"— would  just  about  close  the  conference  and,  of 
course,  innate  the  number  of  returns  for  the  day. 

Accessibility  of  Respondents  for  Questioning.  In  such  a  study 
as  we  are  considering  here,  it  makes  a  difference  if  two  houses 
are  to  be  called  upon  in  each  city  block  or  only  one  house  in 
every  five  blocks. 

If  many  call  backs  are  necessary  to  find  respondents  not  avail- 
able on  the  first  call,  or  if  a  number  of  respondents  must  be  seen 
in  the  evenings  because  occupied  during  the  day  in  business,  the 
work  would  be  retarded  and  the  number  of  interviews  per  day 

affected. 

The  Area  to  Be  Covered.  If  the  city  being  surveyed  runs  largely 
to  suburban  areas,  or  if  it  is  generally  scattered  over  a  wide 
area— a  sprawling  city— the  number  of  interviews  held  in  a 
day  may  be  materially  less  than  it  would  be  if  the  region  were 
densely  populated. 

Then,  the  "city  carrier"  districts  for  newspapers  differ  in 
extent ; 'some  take  in  considerable  country  area  far  beyond  the 
corporate  limits  of  the  city. 

In  determining  the  composition  of  the  field  staff  for  any  such 
extensive  and  impromptu  survey,  all  these  factors  must  be  taken 
into  consideration. 

The  number  of  interviewers  or  reporters  determines  in  a  large 
measure  the  number  of  supervisors,  inspectors,  editors  and 
tabulators.  As  a  result  of  experience  it  may  be  said  that,  m 
general,  one  supervisor  can  effectively  handle  a  crew  of  ten 
investigators,  while  one  inspector  can  follow  twice  that  number; 
their  respective  duties  will  be  outlined  in  due  course.  For  a 
staff  of  twenty  field  workers  two  persons  should  handle  the 
editing  and  probably  four  persons,  the  tabulations,  if  the  work 
is  to  be  done  manually. 

A  newspaper  situation  was  chosen  for  illustrative  purposes 
simply  because  it  provided  a  convenient  vehicle  for  a  discussion 
of  the  several  important  factors.     Those  same  factors  would  not . 
necessarily  affect  the  composition  of  the  staff  required  for  other 
types  of  studies. 

A  manufacturer,  for  instance,  may  want  an  outside  picture  of 
his  distribution  on  the  Pacific  Coast.  A  research  agency  in 
New  York  is  engaged  to  make  the  study.  It  has,  or  engages,  one 
or  two  investigators  in  Spokane  for  the  eastern  Washington  area; 
one  in  Seattle,  perhaps,  and  another  in  Tacoma  for  the  western 
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Washington  area;  one  in  Portland  for  the  western  Oregon  area — 
eastern  Oregon  being  immaterial  in  population;  two  more  in 
San  Francisco  for  northern  California  and  two  in  Los  Angeles 
for  southern  California. 

These  investigators  are  provided  by  mail  with  all  the  material 
'necessary  for  the  work — instructions,  questionnaires,  report 
sheets — and  directed  to  call  on  a  given  number  of  dealers  in 
their  territories.  Usually,  it  is  only  a  few  hundred;  there  is 
no  great  rush  and  the  dealers  are  accessible.  In  such  a  situation 
as  this,  those  factors  we  have  been  discussing  in  detail  would 
have  practically  no  bearing  and  need  not  be  considered  in  the 
planning  process  at  all. 

selection.  The  selection  of  the  required  staff  involves  a 
number  of  factors  which  must  be  considered  in  the  light  of  the 
specific  work  designed  for  each  function — reporting,  supervising, 
instructing,  etc. 

In  selecting  reporters,  for  instance,  the  type  of  person  required 
depends  not  only  upon  that  person's  own  characteristics,  sex, 
personality,  age,  race,  social  position,  educational  equipment, 
intellectual  fitness  and  general  dependability  but,  conversely,  upon 
the  race,  intellectual  plane,  social  position  and  other  correspond- 
ing characteristics  of  the  persons  to  be  interviewed. 

One  of  the  problems  which  arise  in  connection  with  such  a 
newspaper  study  as  has  been  referred  to  is  how  to  recruit  a  suit- 
able field  staff,  as  it  were,  on  the  spur  of  the  moment.  Here  is 
one  method:  There  are  in  most  cities  a  considerable  number  of 
young,  earnest,  industrious,  intellectually  inclined,  college- 
trained  persons,  men  and  women,  fully  qualified  and  awaiting 
their  opportunities  to  enter  the  public  school  system  as  teachers. 
They  are  on  what  is  called  the  " reserve  list."  Properly 
approached,  the  local  superintendent  of  schools  would  probably 
make  this  list  available  to  any  responsible  research  man  for  a 
sizable  study.  Usually,  too,  he  can  even  designate  a  known 
leader  among  these  young  people  who  would  throw  himself  or 
herself  into  the  job  so  vigorously  that  in  twenty-four  hours  the 
staff  would  be  ready  for  action — as  keen  for  the  work  as  a  foot- 
ball squad.  During  vacation  periods,  of  course,  full-fledged 
teachers  are  available  in  the  same  way. 

Very  much  the  same  factors  as  are  involved  in  the  selection  of 
interviewers,  or  reporters,  obtain  also  with  supervisors  and  inspec- 
tors, except  that  their  respective  functions  must  be  kept  clearly 
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in  mind.  Supervisors  are  to  coach;  to  teach  the  interviewers 
on  the  job;  to  correct  any  weaknesses  they  may  find;  and,  most 
particularly,  to  guard  the  field  workers  against  bias  in  their 
interviewing  or  in  their  reports.  Inspectors  are  to  check  the 
fidelity  of  the  work  in  the  field.  Both  supervisors  and  inspectors 
are  staff  officers  and  should  have  the  special  qualifications  each 

requires. 

In  addition  to  all  the  other  general  attributes,  editors  require 
the  further  quality  of  good  judgment.  They  are  to  catch  dis- 
crepancies in  the  work  as  it  is  brought  in  from  the  field,  to  adjust 
inconsistencies,  to  weed  out  invalid  reports  and  replies,  to  apply 
whatever  code  numbers  are  to  be  used  and  generally  to  make  the 
work  ready  for  tabulation.  Frequently  this  work  is  done  by  the 
research  director  himself  or  by  thoroughly  trained  assistants;  but 
in  no  case  should  any  novice  be  entrusted  with  the  function  of 
editing  without  careful  instruction  and  ample  supervision. 

The  cardinal  attributes  of  hand  tabulators  are  those  which 
tend  to  make  them  accurate  in  the  handling  of  large  and  perhaps 
confused  masses  of  figures  or  data.  Aside  from  the  ordinary 
attributes  of  intelligence,  hand  tabulators  should  be  distinguished 
by  a  serious/cautious,  patient,  objective  disposition.  Hand 
tabulating  calls  for  a  meticulous  person.  _        - 

training  The  minimum  training  to  be  planned  for  the  inter- 
viewers should  include  a  general  outline  of  the  study;  a  descrip- 
tion of  the  whole  field  to  be  covered,  as  to  its  characteristics;  some 
instructions  as  to  the  reporter's  conduct  in  the  field;  a  practical 
understanding  of  the  objectives;  the  significance  of  each  question; 
the  importance  of  a  true  and  full  answer  and,  certainly,  the  most 
emphatic  precautions  against  bias. 

The  balance  of  the  staff,  the  supervisors,  inspectors,  editors 
and  tabulators,  also  require  the  training  appropriate  to  their 
respective  functions-all  of  which  should  be  carefully  planned 
in  advance  and  in  the  light  of  the  specific  study  The  subject 
of  training  is  referred  to  in  further  detail  in  Chap.  VIII,  beginning 

on  page  153.  .   ,       .  t.     u 

routine  The  routine  for  the  reporters  or  interviewers  should 
include  a  definition  of  the  territory  each  is  to  cover;  the  time 
each  one  is  to  work;  how  to  locate  their  respondents  and  to  avoid 
hand-picking  them;  all  the  details  of  filling  out  questionnaires 
and  how  and  when  to  report  to  the  research  director.     The  other 
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members  of  the  staff,  the  supervisors,  inspectors  and  editors, 
should  also  be  fully  and  carefully  instructed  in  their  respective 
routines  so  that  there  will  be  no  uncertainty  of  action  when  the 
study  is  set  in  motion. 

In  developing  routine  for  hand  tabulators,  special  care  is 
required  in  the  preparation  of  the  work  sheets  and  in  providing 
a  key  to  accuracy.  In  a  columnar  work  sheet  this  "key"  would 
represent  a  statement  of  the  precise  columns  or  combinations 
of  columns  which  should  balance.  In  hand  tabulation  there  is 
a  necessity  for  frequent  balancing  of  such  columns,  which  have 
been  decided  upon  in  advance,  so  that  the  tabulators  at  the  close 
of  each  group  of  fifty  to  one  hundred  questionnaires  can  check 
the  columns  against  the  key  without  loss  of  time.  This  idea 
will  be  found  illustrated  as  a  practice  in  Chap.  XII,  page  232. 

For  tabulation  by  machine  the  routine  is  concerned  with  the 
careful  coding  of  the  possible  responses  and  a  provision  for  keep- 
ing clearly  defined  the  basic  subdivisions  of  the  work— as  to 
areas,  income  groups,  racial  distinctions  and  other  factors  which 
have  been  predetermined  as  significant  to  the  interpretation  of 
the  completed  study.  A  fairly  full  discourse  on  mechanical 
tabulation  will  be  found  in  Chap.  XIV. 

Samples.  In  any  study  which  requires  observations  from 
separate  sources  too  numerous  or  too  widespread  to  admit  of 
individual  and  complete  coverage,  it  is  customary  in  research 
work  to  rely  upon  data  drawn  from  a  comparatively  small  but 
representative  segment  of  the  field.  This  principle  of  "sam- 
pling" is,  of  course,  well  known  and,  statistically,  its  reliability, 
under  proper  control,  is  demonstrably  sound. 

ntjmbek.  One  of  the  essential  decisions  is  the  minimum  number 
of  samples  necessary  to  give  a  clear  reflection  of  the  information 
desired.  Not  infrequently  a  client  will  stipulate  the  number  of 
interviews  he  wants.  Generally,  it  will  be  some  good  round 
number  he  himself  regards  as  convincing.  Often  such  arbitrary 
specifications  greatly  overshoot  the  mark  and  add  materially 
and  disproportionately  to  the  cost. 

Whether  or  not  the  number  can  be  forecast  exactly  is  still 
problematical.  Statistical  methods  have  been  devised,  based 
upon  the  standard  deviation  found  for  various  numbers  of  inter- 
views where  the  percentage  of  identical  replies  is  known  or  can 
be  estimated;  and  in  some  cases  these  may  serve  a  practical 
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purpose  in  determining  the  number  of  samples  required  within 
a  reasonable  statistical  degree  of  accuracy.  In  some  fields  of 
science  this  system  has  been  used  for  years  and  elaborate  tables 
have  been  prepared  to  facilitate  estimates  as  to  how  many  sam- 
ples are  required  for  a  pre-determined  degree  of  reliability. x 

Even  though  these  methods  are  statistically  sound,  their 
acceptance  as  absolute  guides  in  the  field  of  marketing  seems 
not  yet  assured.  In  such  fields  as  biology  and  sociology  the 
deviations  from  a  norm  are  due  usually  to  congenital,  environ- 
mental, economic  or  other  conditions  which  more  or  less  pervade 
the  subject-field  in  the  type  or  area  under  study;  whereas,  the 
conditions  which  affect  conclusions  in  the  marketing  fields  are 
frequently  the  unpredictable  results  of  stimuli  wholly  artificial 
and  unprecedented.  Unquestionably,  however,  these  statistical 
methods  are  helpful  and  constitute  a  better  basis  for  estimating 
in  advance  the  necessary  number  of  interviews  than  mere  assump- 
tions based  upon  however  much  experience. 

In  the  absence  of  an  absolute  index,  the  practice  has  been — and, 
largely,  still  is — arbitrarily  to  set  a  figure  which  represents  what 
the  research  director  believes  sufficient  in  the  light  of  his  own 
experience  with  the  same  or  similar  studies  or  of  the  correspond- 
ing experience  of  other  research  men.  As  the  work  proceeds,  the 
sufficiency  of  the  sample  may  be  checked  by  the  diminishing 
range  of  divergence  as  determined  by  the  standard  deviation  or 
probable  error. 

In  the  larger  studies,  involving  a  great  many  observations, 
some  research  agencies  set  these  divergences  up  on  what  they 
call  " stabilization  charts"  which  show  the  gradual  approach  of  a 
curve  to  a  static  position.  In  these  cases,  however,  the.  direct 
percentages  are  used — obviating  the  necessity  for  computing 
the  standard  deviation  on  each  group  of  samples. 

The  stabilization  chart,  used  so  effectively  by  Starch,  may  be 
illustrated  by  a  simple  example.  It  can  be  used  in  practically 
all  cases,  but  suppose  that  in  the  newspaper  study  referred  to 
on  page  48  it  were  desired  to  determine  with  some  assurance  that 
the  sample  was  adequate  as  to  each  paper,  the  procedure  would 
be  as  follows: 

The  completed  questionnaires  as  brought  in  from  the  field  each 
evening,  without  any  change  in  their  original  random  sequence, 

1  See  Chap.  XX  of  this  work. 
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would  be  counted  off  in  blocks  of  200;  then  those  respondents 
who  read  Newspaper  A  and  those  who  read  Newspaper  B,  would 
be  counted  off  and  both  results  would  be  expressed  as  a  per- 
centage of  the  200;  then,  there  would  be  added  to  that  first  lot 
a  second  block  of  200  and  the  percentages  of  the  A  and  B  readers 
determined  for  the  combined  400  questionnaires.  Then  a  third 
block  of  200  would  be  added  and  the  percentage  computed  on  a 
total  of  600.  These  cumulative  computations  would  be  con- 
tinued until  all  the  returns  had  been  taken  into  account. 

In  the  meantime  an  ordinary  sheet  of  cross-section  paper  would 
have  been  prepared  listing  the  percentages  in  the  left-hand 
margin  and,  across  the  top,  the  number  of  interviews  combined 
for  each  computation.  As  the  percentages  are  obtained  a  dot 
would  be  placed  opposite  the  proper  figure  and  under  the  number 
of  returns  in  the  block  computed. 

Continuing  this  process  it  would  be  found  that  a  line  connect- 
ing the  dots  would  waver  noticeably  in  the  first  few  calculations 
and  gradually  narrow  its  oscillations  until  it  attained  a  more  or 
less  static  position  on  the  graph.  At  the  point  at  which  the 
curves  achieve  virtual  stability  one  may,  statistically,  conclude 
that,  all-conditions  remaining  unchanged,  no  number  of  additional 
interviews  could  materially  alter  the  showing  of  the  respective 
papers  as  to  percentage  of  readers. 

The  group  of  charts  in  Fig.  3  dealing  with  a  number  of  adver- 
tisements   presents    an  excellent  illustration  of  this  principle. 

distribution.  It  must  be  remembered,  however,  that  in  any 
system  of  determining  the  adequacy  of  sample,  careful  planning 
is  necessary  to  insure  the  taking  of  samples  from  all  groups  and 
all  territories,  within  the  area  being  surveyed,  in  the  approximate 
ratio  which  those  groups  or  those  territories  bear  to  the  whole 

field. 

For  instance,  if  buying  power  is  significant  to  the  study,  as  in 
marketing  research  it  usually  is,  the  sample  should  be  adequate 
not  alone  for  the  whole  area  but  for  each  income  group.  Natu- 
rally, for  some  purposes  as,  for  example,  high-priced  automobiles, 
the  lower  income  brackets  would  have  little  significance;  but  in 
a  study  of  the  advertising  value  of  a  newspaper,  all  income  groups 
are  important  because  all  income  classes  buy  some  merchandise, 
particularly  food,  clothing  and  drugs.  Some  income  classes  buy 
less    and    some    buy    the   lower   priced   grades,   but   they   all 
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Fig.  3. — Stabilization  curves. 
Comparison  of  results  of  samples  of  cumulatively  increasing  size  from  25  to 
1,200  readers  interviewed.  For  example,  the  Camel  advertisement  was  seen  by 
76  per  cent  of  the  first  25  readers,  by  66  per  cent  of  the  first  50  readers,  etc. 
These  advertisements  appeared  in  the  June,  1934,  issues  of  from  four  to  six 
women's  magazines.  (Horizontal  scale  indicates  number  of  readers  interviewed.) 
(Daniel  Starch,  from  address  presented  at  the  Annual  Meeting  of  the  Association  of 
Teachers  of  Marketing  and  Advertising,  New  York,  Dec.  27,  1935.) 
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represent     spending    capacity    exposed    to    that    newspaper's 
advertising. 

Testing.  Before  the  field  work  begins  in  any  broad-scale  mar- 
keting study,  some  means  must  be  planned  for  testing  the  essen- 
tial rightness  of  the  plan  itself,  of  the  questionnaire,  the  staff 
and  the  field.  No  part  of  the  work  should  proceed  without  some 
thorough-going  test  and  some  tests  should  be  repeated  as  the 
work  proceeds.  It  is  indispensable,  for  instance,  to  know  whether 
the  plans  will  prove  sufficiently  sound  and  comprehensive  to 
accomplish  the  aim  of  the  study;  whether  the  questionnaire  will 
prove  adequate,  whether  it  will  bring  out  the  expected  informa- 
tion with  reference  to  the  subject  matter  of  the  study,  whether 
it  needs  deletions  or  additions,  whether  the  questions  have  been 
so  constructed  as  to  produce  practical  answers,  whether  all  the 
questions  are  properly  understood  by  the  reporters,  whether 
they  themselves  are  equal  to  the  work  and,  in  general,  what 
changes  will  be  necessary  to  assure  the  reliability  of  the  study. 
It  is  also  necessary  to  know  definitely  whether  or  not  there  are 
-any  circumstances  in  the  field  that  might  require  changes  either 
in  the  plan  or  in  the  questionnaire. 

where,  when  and  how.  These  several  details  of  testing  are 
important  considerations  and  are  determinable  by  the  circum- 
stances in  each  case— remembering  always  that  the  underlying 
reasons  for  testing  are  accuracy  and  economy.  Beginning  on 
page  89,  in  Chap,  IV,  will  be  found  a  thoughtful  and  constructive 
discourse  on  pretesting  and  retesting,  and  again  in  Chap.  X,  in 
connection  with  the  operations  in  the  field. 

Consider  Costs 

It  will  be  noted  that  we  have  not  said  " computing"  costs. 
This  is  because  the  computation  of  cost  to  a  client  usually  precedes 
the  work.  We  have  said  "  consider ation"  of  costs  deliberately, 
to  connote  a  continuing  care  that  each  step  of  the  planning  be 
taken  with  due  regard  to  an  established  budget. 

Determinable  Costs.  These  are,  of  course,  those  costs  which 
represent  specific  outlays  calculable  in  advance  for  field  work, 
tabulation,  preparation  of  report  and  the  research  agency's  own 
compensation.  All  of  these  are  usually  covered  by  the  original 
estimate  or  appropriation. 
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Contingent  Costs.  These  may  represent  provisions  for  unfore- 
seen features  or  for  extensions  of  the  work.  An  unforeseen  feature 
may  be  some  situation  arising  in  the  course  of  the  study,  of  such 
character  as  to  require  some  specialized  services  as,  for  instance, 
those  of  a  psychologist  or  an  engineer.  Then,  too,  an  extension 
of  the  work  may  be  required  when  the  estimated  sample  fails  to 
provide  a  conclusive  reflection  or  when  more  returns  are  needed 
than  anticipated. 

In  planning  the  cost  of  a  research  operation,  provision  should 
be  made  for  such  contingencies.  In  some  cases,  for  example, 
bids  are  made  for  research  work,  figured  at  a  fixed  amount  for  an 
expected  return  of  completed  questionnaires  with  a  contingent 
rate  on  all  questionnaires  returned  in  excess  of  the  number 
estimated. 

Value  in  Relation  to  Cost.  Before  any  normal  marketing 
study  is  undertaken,  there  should  be  some  clear  indication  of 
its  need.  Certainly  no  professional  research  person  should  under- 
take any  such  work  without  close  inquiry  as  to  its  utility  and 
value  to  his  client. 

Further,  throughout  the  work,  if  undertaken,  some  discrim- 
ination must  be  exercised  as  to  the  utility  of  any  ramification 
that  might  develop.  A  too-ardent  desire  to  be  meticulous,  for 
instance,  in  the  preparation  or  execution  of  the  study  may  lead 
into  bypaths  which,  however  inviting,  might  be  avoided  without 
injury  to  the  result.  Such  excursions  add  cost  to  a  study  but 
no  value. 

Another  familiar  instance  of  disregard  to  cost  lies  in  extending 
the  sample  beyond  reasonable  need.  It  is  not  uncommon  in 
research  work  to  find  the  sample  running  two  or  three  times  over 
what  would  be  liberal  under  the  circumstances.  This  is  usually 
the  result  of  inattention,  but,  unfortunately,  it  is  sometimes  due 
to  a  pettifogging  desire  to  make  a  little  job  look  big. 

Availability  of  Funds.  This  point  is  akin  to  the  idea  of  "  value 
in  relation  to  cost."  It  is  an  ethical  consideration  rather  than 
a  point  of  technique.  In  the  interest  of  marketing  research  as  a 
profession,  it  is  important  to  keep  the  cost  reasonably  within 
practical  bounds  even  with  a  client  willing  and  able  to  indulge  in 
fanciful  explorations.  The  professional  research  person,  like 
any  other  authority,  should  be  sufficiently  trained  and  experi- 
enced to  perceive,  at  least  in  a  general  way,  what  needs  to  be 
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done  in  any  marketing  problem.  Fanciful  ideas  of  clients,  which 
add  nothing  to  the  solution  of  the  problem  but  which  invariably 
waste  the  funds  appropriated  for  the  study,  should  be  gently 
but  firmly  rejected. 

Sometimes  this  is  difficult  to  do.  It  is  comparable  to  the 
situation  in  which  an  advertising  agency  might  resign  an  account 
rather  than  follow  some  executive  into  a  campaign  which  it 
believes  to  be  palpably  defective  in  principle. 

Continuation  Costs.  Most  surveys  come  to  a  decisive  end  at 
the  solution  of  the  problem.  There  are  other  studies,  however, 
which  require  a  periodical  checkup  to  determine  changes  from  a 
previously  established  situation.  This  is  the  principle  underlying 
the  " Brand  Barometer"  of  the  Psychological  Corporation  of 
New  York.  This  "Barometer"  is  designed  to  show  whether 
certain  popular  brands  of  goods  are  increasing  or  decreasing  in 
number  of  outlets  and  in  their  competitive  relation  to  one  another; 
it  is  based  upon  surveys  made  seriatim  at  intervals  of  two  months 
and  so  set  up  as  to  give  significance  to  the  changes  up  or  down. 

Provide  for  Checks  on  Reliability 
Reliability  is  the  sine  qua  non  of  all  research  work;  without 
reliability  research  work  is  nothing.  As  a  matter  of  fact,  it  is 
even  worse  than  nothing— it  is  dangerous.  The  obvious  reason 
for  marketing  research  is  to  provide  a  factual  basis  for  conclu- 
sions upon  which  costly  services  may  be  inaugurated  or  a  com- 
pany's resources  conserved  or  its  capital  adventured.  If  those 
conclusions  are  to  be  dependable,  if  they  are  to  be  free  from 
danger,  the  premises  upon  which  they  rest  must  be  beyond 
question. 

Verification  of  Field  Results.  In  the  execution  of  a  research 
program,  the  function  of  supervisors,  inspectors  and  editors  is 
to  maintain  a  current  verification  of  field  results.  All  the  pre- 
cautions placed  around  interviewers,  hand  tabulators  and  other 
divisions  of  the  staff  are  the  result  of  these  functions.  These 
have  been  referred  to  in  this  chapter  but  in  other  chapters 
throughout  the  book,  the  need  for  verification  will  frequently 
be  stressed  and  the  means  suggested. 

Questions  in  Schedule  to  Check  against  One  Another.  In 
discussing  hand  tabulation,  a  reference  was  made  to  a  "key  to 
accuracy."     To  provide  such  a  "key"  it  is  necessary  that  some 
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of  the  questions  in  the  schedule  bear  a  definite  relationship  to 
certain  other  questions  so  that,  as  tabulation  proceeds,  they 
may  be  checked  against  one  another. 

As  a  simple  example:  in  a  study  of  newspaper  readership  there 
are  questions  designed  to  determine  the  race  of  the  persons  called 
upon-whether  white,  colored  or  other;  some  questions  are 
designed  to  determine  the  various  newspapers  read  by  each 
person  interviewed— how  many  read  one  paper,  two  papers, 
three  papers,  no  papers;  and  still  other  questions  designed  to 
determine  how  the  papers  are  acquired-whether  delivered  at 
home,  at  an  office,  bought  on  the  street  or  otherwise.  All  these 
questions  should  check  with  the  total  number  of  calls  made. 
This  is  obvious,  because  each  person  called  upon  must  belong  to 
one  of  the  races;  must  either  read  some  paper  or  no  paper;  and 
must  acquire  the  paper  by  some  one  of  the  means  indicated. 
This  idea  will  be  elaborated  in  detail  in  discussing  the  Organiza- 
tion of  Data  in  Chap.  XII,  page  232. 

Public  Records,  Census,  etc.  As  a  further  check  on  reliability 
there  are  in  every  market  a  number  of  sources  of  related  informa- 
tion against  which  such  details  as  the  number  of  telephones,  the 
number  and  types  of  automobiles,  the  number  and  value  oi 
homes  owned  and  rented  and  many  other  local  circumstances 
may  be  compared.  As  a  matter  of  planning,  it  is  well  to  have 
these  sources  in  mind  from  the  very  beginning  of  a  work. 

A  good  illustration  of  this  sort  of  checking  can  be  drawn  from 
the  newspaper  survey  considered  earlier  in  this  chapter.  Divest- 
ing the  example  of  all  complicating  features,  let  us  suppose  that 
the  field  survey  showed  that  73  per  cent  of  the  families  called 
upon  read  regularly  Newspaper  A;  if  the  number  of  families  m 
that  city  were  65,000,  Newspaper  A's  circulation,  as  projected 
from  the  sample,  would  be  47,450.  Reference,  now  to  the 
latest  report  of  the  Audit  Bureau  of  Circulation  should  show 
Newspaper  A's  authenticated  circulation  to.be  somewhere  in 
the  neighborhood  of  the  figure  shown  by  the  survey. 

Similarly,  suppose  that  32  per  cent  of  the  families  called  upon 
own  cars;  the  cars  registered  for  license  purposes  in  that  area 
should  be  somewhere  around  21,000  cars.  If  the  families  having 
telephones  have  been  recorded,  the  result,  extended  to  the  whole 
population,  should  check  with  the  telephone  installations  as 
shown  by  the  local  telephone  company.     The  number  of  homes 
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owned  can  be  checked  at  the  city  tax  bureau;  neighborhood 
rentals,  perhaps,  at  the  real  estate  exchange;  and  racial  divisions, 
as  white  and  colored  families,  with  the  Federal  Census  breakdown. 

The  closer  the  research  figures  check  with  these  independent 
records,  the  greater  the  credibility  of  the  study  as  a  whole. 
Purely  as  a  matter  of  measuring  the  believability  of  such  a 
study,  therefore,  it  is  well,  if  possible,  to  include  some  such  ques- 
tions in  the  schedule,  even  if  they  are  not  immediately  concerned 
in  the  issue. 

Similar  Studies  Made  by  Others.  It  is  not  to  be  expected 
that  any  two  studies  will  prove  identical  in  every  respect,  but 
on  nearly  every  subject  nowadays  some  researches  may  be  found 
which  can  be  used  as  a  check  on  the  accuracy  of  another  study. 
The  books  and  magazine  articles  listed  in  the  bibliography  at  the 
end  of  this  book  contain  references  to  many  such  researches. 
They  are  all  modern,  in  the  sense  that  they  have  been  published 
during  the  more  or  less  recent  past;  they  deal  with  all  phases  of 
research  in  technique  and  practice  and  they  relate  to  almost 
every  kind  of  marketing  problem. 

This  completes  the  review  of  the  matters  requiring  considera- 
tion and  planning  in  advance  of  a  marketing  study.  In  the 
following  chapters  all  the  steps  which  have  been  discussed  in 
connection  with  Planning  the  Procedure  will  be  examined  more 
closely  as  matters  of  practice. 


CHAPTER  III 

PSYCHOLOGICAL  ASPECT  OF  QUESTIONNAIRE 
DEVELOPMENT1 

No  questionnaire  can  lead  to  valuable  results  if  the  interviewer 
has  not  the  right  personality  or  does  not  know  how  to  interview. 
But  any  interview  can  be  improved  and  its  results  made  incom- 
parably more  valuable  for  the  final  report  if  the  questionnaire 
fulfills  certain  psychological  requirements.  It  is  with  these 
psychological  features  of  a  good  questionnaire  that  the  present 
chapter  is  concerned.  _ 

These  features  can  be  grouped  roughly  according  to  the  follow- 
ing specifications: 

1.  A  good  questionnaire  should  make  it  easy  to  obtain  the  necessary 
information  from  the  respondent. 

2.  It  should  take  into  account  the  influence  which  its  own  wording  might 
have  upon  the  replies  of  the  respondent. 

3    It  should,  by  adequate  formulation  and  arrangement,  lay  the  ground- 
'  work  for  the  sound  analysis  and  successful  interpretation  of  the  returns. 

These  three  main  ideas  will  be  elaborated  in  some  detail  and 
concrete  examples  will  be  presented  to  demonstrate  them. 

Helping  the  Respondent  to  Talk 
The  average  interviewer  in  market  research  has  to  assume 
that  the  respondent  is  willing  and  able  to  give  the  information 
requested  of  him.  The  idea  that  the  respondent  might  try  to 
deceive  the  interviewer  is  always  a  possibility.  In  general,  how- 
ever it  can  be  avoided  not  by  special  formulations  of  the  ques- 
tionnaire, but  only  by  not  starting  an  investigation  m  which 
interviewers  are  likely  to  be  deceived.  A  man  on  re hef  is  not 
supposed  to  earn  any  money;  therefore,  no  one  should  start  a 
routine  interview  with  him  about  his  earnings  during  the  past 
»  This  discourse,  extending  over  two  chapters,  is  interpolated  here  because 
of  its  close  relationship  with  the  stage  of  plannmg. 
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week,  even  if  there  should  be  reason  to  believe  that  he  had  made 
money  during  that  time. 

In  addition  to  this,  one  has  to  reckon  with  unintentional  dis- 
tortions. People,  for  example,  have  a  hard  time  remembering 
experiences  of  their  early  childhood  and  what  they  do  remember 
is  very  likely  a  biased  selection  of  what  actually  did  happen. 
There  are  ways  of  very  careful  and  extensive  interviewing  which 
greatly  improve  the  recollection  of  early  childhood  experiences, 
but  since  there  is  no  chance  to  introduce  this  type  of  analytical 
interview  in  an  average  market  study,  it  is  not  being  considered 
here  either. 

In  the  following  pages  will  be  considered  only  the  average 
interview  for  which  fifteen  or  twenty  minutes  are  available  and 
from  which  unusually  complicated  topics  of  exceptionally  awk- 
ward character  have  to  be  eliminated  and  transferred  to  more 
subtle  forms  of  investigation. 

After  what  might  be  called  the  realm  of  the  average  question- 
naire has  been  so  outlined,  the  following  three  problems  present 
themselves    for    immediate    consideration.     The    respondent — 

(1)  might  have  a  hard  time  to  remember  the  matter  he  is  being  asked 
about ; 

(2)  might  remember,  but  be  too  embarrassed  to  give  a  proper  answer; 

(3)  might  remember  and  be  willing  to  tell  but  lack  the  right  way  of 
expressing  himself. 

Aiding  the  Respondent  to  Remember.  The  ways  in  which  a 
questionnaire  can  come  to  the  aid  of  the  respondent's  memory 
all  revert  to  the  one  idea  of  making  the  problem  as  concrete  as 
possible  for  him.  The  question  should  be  fitted  so  well  into  the 
respondent's  own  experience  that  he  reviews  in  his  memory  what 
has  happened  to  him,  as  in  a  motion  picture,  and  picks  out  those 
elements  with  which  the  inquiry  is  particularly  concerned. 

Reilly1  gives  a  good  example.  If  a  man  is  asked  how  often 
during  a  month  he  changes  his  razor  blades,  he  has  to  make  a 
considerable  computation.  If,  instead,  he  is  asked  how  long  a 
razor  blade  lasts,  he  is  brought  at  once  to  a  situation  in  which 
he  probably  finds  himself  every  morning.  These  questions  might 
elicit  substantially  the  same  information;  but  in  the  one  case, 

1  Reilly,  W.  Jm  Marketing  Investigation,  Ronald  Press  Company,  New 
York,  1929. 
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more  than  in  the  other,  the  question  is  fitted  into  the  respondent's 
experience  and  is  likely  to  result  in  a  more  definite  response. 

In  a  study  regarding  attendance  on  motion  pictures,  it  was 
desired  to  know  why  people  went  to  see  them,  how  they  selected 
their  company  and  what  made  them  choose  the  special  pictures 
they  went  to  see.  It  was  found  that  in  some  cases  the  questions 
brought  good  responses  while  in  other  cases  the  results  were  quite 
meager  After  careful  analysis  it  was  decided  to  run  two  sets 
of  questions,  the  one  for  people  who  went  mainly  to  see  a  par- 
ticular picture  and  the  other  for  those  who  went  more  for  general 
entertainment  and  with  no  special  regard  for  the  picture 

Where  the  interest  in  the  picture  was  predominant,  the  next 
question  was  as  to  when  and  how  the  respondents  learned  about 
it  and  what  interested  them  in  it;  only  then  were  questions  asked 
about  company  and  why  the  respondents  went  just  when  they 
did  In  the  other  case  it  was  asked  first  why  they  decided  to 
go  to  the  movies  and  how  they  chose  their  company;  then,  only, 
was  the  question  put  as  to  how  they  selected  the  special  picture 
and  what  interested  them  in  it. 

The  whole  technique  might  be  called  interviewing  along  the 
time  line.     It  aims  to  get  the  history  of  the  act  just  as  it  went 
on  from  step  to  step.     Everyone  knows  that  a  concrete  way  ol 
interviewing,  such  as  this,  helps  greatly  in  bringing  about  an 
exact  recollection.     If  we  cannot  find  a  book,  we  try  to  visualize 
very  clearly  the  last  moment  when  it  was  still  in  our  possession.  ( 
Then  we  try  to  remember  every  move  we  made  from  that  moment 
on  because  we  know  from  experience  that  finally  we  will  stumble 
in  our  memory  over  the  moment  when  we  put  the  book  away. 
Certainly,  many  of  us  have  found  lost  objects  in  just  such  a  way. 
The  technique  of  interviewing  here  being  advocated  is  very 
similar  to  this  procedure.     When  we  want  to  know  what  someone 
did  yesterday  at  eight  o'clock  in  the  evening,  we  ask  him  farst 
when  he  left  his  office,  because  we  are  sure  that  he  remembers 
that.     Then  we  ask: -What  did  you  do  next?"     "Next?       And 
so  on      While  going  along  the  time  line  of  his  own  experience,  the 
probability  that  we  shall  hit  eight  o'clock  together  is  much 
greater  than  if  we  ask  him  to  go  back  to  that  particular  time 
without  a  lead  to  guide  him. 

Following  up  the  respondent's  own  experience  by  the  order 
of  questioning  is  only  one  method  of  being  as  concrete  as  possible. 
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Another  way  is  to  avoid  too  general  a  question.  If  a  reader  of  the 
Magazine  X  is  asked,  "Did  you  ever  buy  anything  as  a  result  of 
an  advertisement  in  X  magazine?"  There  is  put  before  him  a 
very  large  field  of  activity — through  the  use  of  the  word  "buy." 
It  is  easier  for  the  respondent  to  answer  the  following  three 
questions,  which  cover  the  same  topic  in  a  more  concrete  way: 

"Have  you  ever  bought  anything  in  a  store  as  the  result  of  an  X  adver- 
tisement?" 

"Have  you  ever  ordered  anything  by  mail  from  an  advertiser  in  X  maga- 
zine as  the  result  of  an  X  advertisement?" 

"Have  you  ever  written  for  any  information,  a  booklet,  or  a  premium  in 
connection  with  an  X  advertisement?" 

Such  questions  as  these  are  not  only  more  specific  and  concrete 
but  they  yield  more  information  of  the  type  Magazine  X  can 
use  to  advantage  in  selling  space. 

Another  field,  in  which  a  more  specific  question  improves 
returns,  is  opened  up  when  one  seeks  to  learn  the  respondent's 
requirements  in  regard  to  a  certain  commodity.  If  he  is  asked 
what  he  believes  is  of  importance  in  a  good  pair  of  gloves,  he 
might  have  a  hard  time  to  answer;  but,  if  he  is  asked  first  about 
his  last  purchase  of  gloves  and  why  he  decided  to  buy  the  pair 
he  did,  he  is  brought  back  at  once  to  a  concrete  situation.  It  is 
then  much  easier  to  go  on  to  a  generalization  of  what  is  important 
in  gloves.  He  considered  the  matter  when  he  last  bought  gloves 
and  will  remember  his  considerations. 

This  leads  to  the  general  advice  to  include  in  the  questionnaire 
the  last  purchase  as  often  as  possible.  More  information  will 
usually  be  secured  out  of  an  analysis  of  one  last  purchase  than 
out  of  any  question  about  general  ideas — unless  such  a  question 
is  likewise  associated  with  the  respondent's  recollection  of  con- 
crete experiences.  Many  fallacies  in  studies  which  attempt  to 
evaluate  requirements  of  people  in  different  markets  are  due  to 
such  lack  of  concrete  "last-purchase"  analysis. 

Finding  Substitutes  for  Embarrassing  Questions.  However 
eager  one  may  be  to  know  how  many  baths  a  week  a  respondent 
takes,  one  cannot  ask  him  directly.  But  a  procedure  like  this 
can  be  introduced :  The  respondent  can  be  told  that  some  eminent 
doctor  claims  that  too  many  baths  are  not  good  for  one's  health; 
then,  he  can  be  asked  how  he  feels  about  it  and  what  his  experi- 
ence is.     During  the  ensuing  discussion  there  will  be  no  trouble 


66  THE  TECHNIQUE  OF  MARKETING  RESEARCH 

in  finding  out  the  number  of  baths  the  respondent  feels  is  appro- 
priate for  himself. 

This  general  idea  has  been  developed  to  a  very  effective  pro- 
cedure by  White.1  His  experience  was  that  many  well-to-do 
people  would  not  confess  that  they  read  certain  types  of  "low- 
brow" magazines.  He,  therefore,  arranged  with  a  charitable 
organization  to  procure  old  magazines  that  it  could  give  away 
to  the  poor;  then,  he  had  his  interviewers  call  upon  upper-class 
housewives  and  ask  if  they  would  donate  or  sell  their  used  maga- 
zines From  the  interviewer's  returns,  White  found  that  the 
women  providing  certain  types  of  magazines  exceeded  by  50  per 
cent  the  number  of  women  who,  in  direct  interviews,  would 
admit  reading  them.  . 

The  psychological  implication  in  this  procedure  is  that  the 
accent  of  attention  is  shifted  away  from  the  embarrassing  side 

of  the  matter. 

This  principle  should  also  be  considered  in  studies  designed  to 
ascertain  the  extent  to  which  people  are  influenced  m  their  pur- 
chasing by  the  advice  of  others.  People  questioned  as  to  whether 
they  have  asked  advice  regarding  certain  purchases  may  be  unwill- 
ing to  answer-particularly  if  a  frank  answer  would  tend  to 
reflect  on  their  taste,  judgment  or  social  standing.  It  is  sug- 
gested, therefore,  that  they  be  asked  whether  others  have  come 
to  them  for  advice.  Statistically,  the  investigation  is  on  the  same 
trail  and,  psychologically,  this  question  is  more  likely  to  produce 
reliable  information.  There  are  no  general  rules  for  this  sort  ol 
question.  It  must  be  adapted  to  each  particular  case.  Ihe 
important  thing  is  to  keep  in  mind  the  problem  of  psychological 
resistance  and  to  look  for  ways  to  avoid  it  in  the  construction 
of  the  questionnaire. 

Giving  Means  of  Expression.  Sometimes  people  are  able  to 
remember  and  willing  to  talk,  but  they  lack,  so  to  speak,  a  way 
of  expressing  themselves.  This  is  especially  true  when  opinions 
must  be  indicated  with  more  than  usual  precision. 

In  one  city  a  brand  of  shoes  was  sold  which  had  the  reputation 
of  exceptionally  good  quality.  The  investigator's  impression 
was  that  the  very  high  reputation  of  this  brand  scared  people 
of  moderate  means  and  deterred  them  from  buying  it.  In 
<  White,  Percival,  Market  Analysis,  McGraw-Hill  Book  Company  Inc., 
New  York,  1921. 
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reality,  these  shoes  were  not  particularly  expensive.  Because 
price  and  pride  were  involved,  people  would  not  willingly  disclose 
their  attitude  toward  this  brand  of  shoes  without  being  ques- 
tioned. A  direct  question  would  have  biased  their  replies,  so 
they  were  asked  how  expensive  this  brand  of  shoes  was,  in  their 
opinion.  The  estimated  price  was,  on  the  average,  much  too 
high.  This  discrepancy  clearly  confirmed  the  investigator's 
theory  and  provided  the  manufacturer  with  a  factual  basis  for 
his  corrective  plans. 

In  another  case,  there  were  two  brands  of  quality  pencils  which 
sold  at  the  same  price;  however,  the  prices  reported  for  the  lesser 
known  brand  were  on  the  average  20  per  cent  lower  than  the 
other.  In  these  cases  opinion  of  price  indicated  opinion  of 
quality.  White,1  in  a  study  on  commercial  radio  advertising, 
used  a  similar  technique.  He  asked  his  respondents  how  many 
minutes  out  of  the  average  quarter-hour  program  are  used  for 
the  commercial  part  of  a  broadcast.  The  guesses  centered 
around  three  minutes,  whereas  the  actual  average  time  was  only 
two  minutes.  This  is  a  good  way  to  show  whether  people  are 
bored  by  commercial  announcements. 

It  is  not  always  possible  to  use  such  conclusive  measures  as 
dollars  or  minutes.  In  a  study  regarding  milk  drinking,  it  was 
desired  to  know  how  people  felt  about  the  food  value  of  milk; 
so,  Link2  introduced  the  following  set  of  questions:  " Which  do 
you  consider  more  nourishing — a  bottle  (pint)  of  milk,  or  one 
half-pound  of  beefsteak,  a  half-pound  of  potatoes,  two  eggs,  or  a 
half-pound  of  string  beans?"  Actually  these  four  portions  of 
food  and  the  indicated  amount  of  milk  are  about  equivalent  from 
a  physiological  point  of  view.  People  are  able  in  this  way  to 
express  opinions  about  milk  which  they  would  not  have  been  able 
to  formulate  in  so  many  explicit  words. 

This  same  idea  underlies  the  use  of  pictures  in  questionnaires — 
so  successfully  introduced  in  this  country  by  Weaver.3  His  plan 
is  to  put  several  different  designs  of  radiators,  for  instance, 
before  his  respondents  and  ask  them  to  select  the  one  they  like 

1  White,  Percival,  op.  cit. 

2  Link,  Henry  C,  The  New  Psychology  of  Selling  and  Advertising,  The 
Macmillan  Company,  New  York,  1932. 

3  Henry  G.  Weaver,  Director  of  Customer's  Research,  General  Motors 
Corporation. 
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best  and,  if  so  inclined,  to  make  additional  suggestions.  This 
system  is,  of  course,  much  easier  for  the  individual  than  to  explain 
Ids  predilection  without  any  help.  The  less  a  problem  is  suited 
to  verbalization,  the  more  important  does  pictorial  expression 

become.  ,.  , 

In  several  European  studies,  this  pictorial  idea  was  of  great 
value  in  locating  certain  troubles  people  were  having  with  shoes. 
The  pain  could  be  located  easily  enough,  but  not  the  trouble 
The  difficulty  was  to  determine  just  what  part  of  the  shoe  was  at 
fault  People  knew  too  little  about  shoes  to  describe  the  parts 
so  the  questionnaire  included  a  schematic  picture  of  a  shoe  which 
enabled  the  wearers  easily  and  quickly  to  designate  the  source 

of  the  trouble.  , 

It  is  no  great  step  from  such  procedures  to  the  use  of  samples. 
Language  provides  very  few  words  for  taste.  Thus,  in  a  choco- 
late study  it  was  found  almost  impossible  to  get  exact  information 
about  preferences.  But,  when  the  respondent  was  given  several 
different  samples  and  asked  to  comment  while  tasting  them,  his 
communications  were  much  improved.  This  procedure  leads 
directly  to  the  techniques  used  in  experimental  psychology. 

Experimental  Psychology  in  Market  Research 
Wherever  the  direct  question  is  not  likely  to  yield  reliable 
results,  the  procedures  of  experimental  psychology  come  into  their 
own      Recent  experiments  in  human  perception,  for  instance, 
have  been  brought  successfully  to  the  service  of  market  research. 
The  Psychological  Corporation*  has  elaborated  a  series  of  studies 
in  product  improvement;  Jenkins*  has  analyzed  what  concentra- 
tion of  sirup  would  be  best  for  a  well-known  beverage  and  Ripin 
with  Lazarsfeld  has  studied  the  touch  qualities  of  different  fabrics 
In  modern  psychology  the  experimental  branch  is  the  one  most 
highly  developed-with  very  diversified  and  refined  techniques. 
In  such  a  work  as  this  it  is  not  possible  to  give  any  comprehensive 
1The  Psychological  Corporation  is  an  association  of  psychologists  of 
recognized  professional  standing,  with  headquarters  m  New  York  C^ 
This  organization  makes  consumer  and  dealer  studieS,  has  published 
lumber  of  articles  and  brochures  on  various  phases  °^™  and  market 
research  and  is  associated  in  the  editorship  of  the  Journal  of  Apphea 

PS*tt9VG.    Jenkins,    Department    of    Psychology,    Cornell    University, 

Ithaca,  N.Y. 

3  Rowena  Ripin,  of  the  Psychological  Corporation. 
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idea  of  the  whole  field  developed  by  these  techniques.  Their 
application  to  advertising  alone  fills  a  whole  volume — as  shown 
by  Poffenberger  in  his  Psychology  of  Advertising.1  Further,  these 
techniques  are  too  far  away  from  the  questionnaire  problem  to 
warrant  presentation  here  in  detail.  In  a  general  way,  however, 
the  following  example  illustrates  their  application. 

A  certain  well-known  brand  of  soap  was  advertised  as 
being  helpful  in  avoiding  " cosmetic  skin."  The  theme  was  that 
if  a  woman  would  wash  her  face  every  evening  with  this  soap 
the  use  of  cosmetics  would  not  be  dangerous  for  her.  A  con- 
troversy sprang  up  on  the  question  as  to  whether  such  an 
advertising  campaign  were  not  detrimental  to  the  cosmetic 
manufacturers,  and  a  study  was  undertaken  to  decide  the  ques- 
tion by  psychological  experiments.  Together  with  four  others,  a 
typical  experiment  in  association  was  performed.  Two  groups 
of  women  were  selected,  similar  in  age  and  social  status;  one 
group  knew  of  the  advertisement  and  the  other  did  not.  The 
individual  women  in  each  group  were  given  short,  unfinished 
incidents,  which  they  were  asked  to  complete.  The  decisive 
question  read  about  as  follows:  "A  young  woman  awoke  one 
morning  to  find  that  her  face  was  covered  with  pimples;  what 
might  be  the  reason?"  The  purpose  was  to  find  out  if  those 
women  who  had  read  the  soap  advertisement  would  be  more 
likely  to  attribute  the  bad  skin  to  the  use  of  cosmetics.  If  that 
were  so,  then,  it  would  very  likely  be  that  the  advertisement  was 
indeed  raising  a  bias  against  cosmetics. 

Every  marketing  student  should  acquaint  himself  with  some 
standard  work  on  experimental  psychology  of  which  several  are 
listed  in  the  bibliography  in  the  back  of  this  book.  Familiarity 
with  the  methods  therein  will  help  him  in  many  difficult  situa- 
tions throughout  his  career. 

Anticipating  the  Influence  of  the   Questionnaire 

upon  the  Answers 

Pursuant  to  a  formulation  of  Jenkins,2  it  can  be  said  that  every 
answer  is  a  function  of  the  question  asked.  There  is  no  way  to 
avoid  the  fact  that  changes  in  the  question  will  change  the  reply. 

»  1  Poffenberger,  A.  T.,  Psychology  of  Advertising,   McGraw-Hill  Boek 
Company,  Inc.,  New  York,  1932. 

2  Jenkins,  John  Gm  Psychology  in  Business  and  Industry,  John  Wiley  & 
Sons,  Inc.,  New  York,  1935. 
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What  the  questioner  has  to  do  is  to  be  aware  of  this  influence,  to 
take  it  into  account  in  his  interpretations  and  especially  to  avoid 
elements  in  the  questionnaire  which  might  make  this  task  impos- 
sible to  fulfill. 

There  are  two  considerations  which  are  important  here:  (1)  the 
wording  of  a  question,  and  (2)  the  position  of  a  question  in  the 
whole  context  of  the  questionnaire. 

Leading,  Misleading  and  Ambiguous  Questions.  The  danger 
of  the  leading  question  was  one  of  the  first  to  be  discussed  in  the 
history  of  market  research.  So  much  has  been  said  about  it  that 
it  is  now  practically  eliminated.  If  it  were  desired  to  know 
whether  or  not  a  respondent  likes  a  certain  blue  color,  it  would 
not  do  to  ask  him-"  Is  not  this  a  nice  blue  color?"  Nor  should 
he  be  asked— " Do  you  like  this  color?"  Even  that  form  might 
give  that  color  a  distinguished  position  which  might  bias  the 
reply  It  would  be  best  to  show  the  respondent  several  colors 
and  ask  which  he  likes  best.  This  would  probably  bring  to 
light  what  the  interviewer  wishes  to  know:  does  he  like  that 
particular  blue  or  not?  There  are,  fortunately,  few  leading 
questions  in  present-day  studies;  the  subject,  therefore,  requires 
no  prolonged  discussion  here. 

It  should  be  said,  however,  that  the  leading  question,  is  mostly 
due  to  psychological  ignorance,  while  the  misleading  question 
is  a  result  of  bad  faith.  Suppose  a  manufacturer  advertises  that 
his  drug  is  made  from  costlier  ingredients.  The  advertising 
agency  wants  to  prove  that  this  is  a  good  slogan  and  they  ask 
a  thousand  housewives:  "Do  you  want  this  drug,  made  from 
costlier  ingredients?"  97  per  cent  reply,  "Yes";  and  the  agency 
points  out  how  good  this  slogan  is.  Of  course,  every  housewife 
wants  the  costlier  stuff;  but  the  real  problem  is,  do  they  believe 
that  the  drug  is  now  being  made  of  it?  The  issue  is  suborned 
by  a  misleading  question.1 

i  The  artless  reader  might  feel  that  such  things  never  happen.  However, 
a  leading  commercial  institution  of  this  country  tested  the  attitude  of  its 
members  toward  some  of  the  policies  of  the  Federal  administration  by 
asking  among  other  questions:  "Do  you  think  that  the  Federal ;£*™S 
should  interfere  with  problems  which  are  proper  affairs  of  the  states !  Of 
course,  there  was  a  unanimous  "No."  However,  the  real  problem  here  » 
to  have  a  fair  judgment  of  what  are  the  proper  affairs  of  the  states.  Ine 
question  was  completely  misleading. 
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More  frequent  than  leading  or  misleading  questions  are  ambig- 
uous questions.  They  very  often  slip  in,  by  inadvertence,  even 
when  the  compiler  of  the  questionnaire  is  both  experienced  and 
competent. 

In  a  study  some  time  ago,  the  attitude  of  women  toward 
cosmetics  was  tested  by  having  them  agree  or  disagree  with 
statements  like  this:  " Every  well-bred  woman  uses  cosmetics" 
and  "The  majority  of  cosmetics  are  detrimental  to  the  skin." 
The  positive  and  negative  statements  were  carefully  balanced  in 
order  to  avoid  any  bias.  One  of  the  sentences,  however,  read — 
"A  good-looking  lady  does  not  need  to  paint  herself."  When  a 
woman  answered  "Yes"  to  this  statement,  it  was  impossible 
to  determine  if  she  actually  agreed  with  the  idea — that  a  lady 
did  not  need  paint;  or  if  she  disagreed — as  by  saying  "Oh  yes"  to 
imply  that  a  good-looking  lady  does  need  to  paint  herself. 

There  is  a  distinction  between  logically  and  psychologically 
ambiguous  questions.  The  cosmetic  question  is  logically  all 
right,  but  psychologically  it  leads  many  women  to  give  the  wrong 
answer;  because  they  are  more  concerned  with  the  content  of 
the  statement  than  with  its  form.  If  a  lecturer  should  want  to 
explain  to  a  class  of  students  what  a  psychologically  ambiguous 
question  is,  he  might  suddenly  interrupt  his  lecture  and  ask: 
"Do  you  know  what  time  it  is?"  Probably  half  of  the  class 
would  shout:  "10:30."  Then,  the  lecturer  would  proceed  to 
show  that  the  appropriate  answer  would  have  been:  "Yes,  I 
know  what  time  it  is"  and  that  the  class  had  not  listened  to  the 
form  of  the  question  but  only  to  what  was  felt  to  be  its  purpose. 

Another  form  of  ambiguous  question  arises  from  the  introduc- 
tion of  two  items  in  one  sentence.  Suppose,  for  instance,  that 
the  question  is:  "Do  you  think  that  X  blankets  are  smooth  and 
warm ;  yes  or  no  V '  The  respondent  who  feels  that  they  are  warm 
but  not  smooth  would  have  no  way  to  express  such  an  opinion 
within  the  frame  of  the  question.  The  best  way  to  avoid  ambig- 
uous questions  is  by  pretesting  the  questionnaire — a  proceeding 
which  will  be  discussed  at  the  close  of  the  next  chapter. 

A  clear  distinction  has  to  be  made  between  questions  which 
so  influence  the  returns  as  to  become  useless  and  those  which 
influence  them  in  a  way  that  can  be  appraised. 

The  Psychological  Corporation  found  that  48  per  cent  of  the 
respondents  said  "Yes"  when  they  were  asked:  "Are  you  in 


72  THE  TECHNIQUE  OF  MARKETING  RESEARCH 

favor  of  a  rise  in  prices  in  order  to  bring  back  recovery?"  When 
the  wording  was  amended  to  read  "  a  reasonable  rise"  the  number 
of  favorable  replies  doubled.  Here,  of  course,  we  have  a  positive 
result  which  can  be  interpreted.  The  difference  between  rise 
and  "reasonable  rise"  makes  two  different  questions  and  it  is 
not  surprising  that  they  were  answered  in  a  substantially  different 

W  The  Position  of  the  Question  in  the  Questionnaire.     Replies 

to  a  question  are  frequently  influenced  by  associations  arising 

from  questions  preceding  it  in  the  questionnaire.     In  a  certain 

survey    the  attitude  of  women  toward  advertising  was  being 

studied.     In  some  of  the  cases  questions  regarding  dresses  were 

put  first;  in  the  others,  attitude  questions  came  first.     It  turned 

out  that  in  the  former  cases,  dresses  first,  the  attitude  toward 

advertising  was  on  the  average  notably  more  favorable.     An 

analysis   of   the  reasons   showed   the  following   connection:   I 

women  were  asked  first  about  advertising,  they  thought  about  all 

sorts  of  advertising-food,  dresses,  cigarettes,  etc.;  but  when 

dresses  were  mentioned  first,  they  were  inclined  thereafter  to 

think  mainly  about  dress  advertising.     As  the  women  s  attitude 

toward  dress  advertising  was  more  favorable  than,  for  instance 

toward  food  and  drug  advertising,  marked  differences  appeared 

in  the  two  samples.  .  • 

Sometimes  it  is  not  possible  or  even  advisable  entirely  to 
eliminate  such  influences.     Then  they  must  be  taken  into  account 
by  special  questions.     Readers  of  a  technical  magazine  were 
interviewed  in  a  Certain  study.     They  were  spoken  to  first  about 
their  hobbies  and  technical  interests  and  then  asked,     Did  you 
ever  buy  anything  following  up  an  advertisement  in  *  maga- 
zine?"    There  was  ample  evidence  of  buying  tools  and  other 
technical  material  but  very  few  reports  regarding  other  common 
commodities.     It  was  necessary  to  insert  special  questions  regard- 
ing food,  garments  and  other  such  items.     The  earlier  questions 
and  discussions,  regarding  "hobbies  and  technical  interests 
set  the  respondents  in  such  a  frame  of  mind  that,  when  questioned 
about  purchases,  they  could  associate  buying  only  with  the 
technical  aspect  of  the  opening  conversation. 

A  question  influences  succeeding  ones  if  it  mentions  anything 
which  might  bias  the  respondent  in  his  later  replies.  If  one  is 
most  interested  in  brand  Y  it  may  be  very  important  to  discover 
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not  only  what  the  consumers  in  a  certain  market  know  about  the 
brand  Y  but  also  what  brands  in  general  they  do  know.  In  such 
a  case  one  should  have  to  ask  two  questions  in  the  following  order : 

"What  brands  do  you  know?" 

"What  do  you  know  about  brand  YV 
It  might  be  that  while  some  respondents  fail  to  mention  Y  on  the 
first  question,  because  it  is  not  important  for  them,  they  would, 
if  asked  the  second  question  first,  report  all  sorts  of  hearsay,  as 
of  their  own  knowledge.  That  would  be  a  very  characteristic 
result.  Reversing  the  order  of  the  two  questions  reminds  the 
respondent  of  brand  Y;  and  thereafter  it  could  never  be  deter- 
mined whether  or  not  the  respondent  would  have  remembered 
brand  Y  without  that  prompting.  These  subtle  influences  creep 
so  slyly  into  questionnaires  that  no  research  man  should  ever 
put  one  into  use  without  first  testing  it  for  just  such  weaknesses. 

The  order  of  questions  has  to  be  regarded  from  still  another 
point  of  view — the  effect  it  has  on  the  patience  and  energy  of  the 
respondent.  In  general,  the  respondent  treats  more  carelessly 
the  questions  in  the  last  part  of  a  long  interview.  Questions 
of  special  importance  should,  therefore,  be  put  in  a  preferred 
position.  This  does  not  mean  that  the  first  questions  which 
meet  the  respondent  rather  unprepared  are  in  the  best  position. 
In  practice  it  is  necessary  to  find  out  for  each  questionnaire  just 
when  the  average  respondent  wears  out  and,  also,  at  just  what 
point  he  acquires  the  most  favorable  mood.  Somewhere  in 
between  these  two  points  should  be  put  those  questions  which 
are  of  greatest  interest  and  on  which  the  most  reliable  and  elabo- 
rate replies  are  required. 

The  Problem  of  the  Check  List.  Every  research  person  who 
prepares  questionnaires  meets  sometimes  with  this  fundamental 
problem:  Shall  he  leave  the  respondent  free  to  answer  a  question 
in  any  way  he  chooses,  or  shall  he  give  him  a  list  of  possible 
replies  and  just  have  him  check  the  answer  appropriate  to  his  case? 

Both  procedures  have  advantages  and  disadvantages.  The 
check  list  makes  the  recording  and  the  tabulating  of  the  answers 
much  easier  and  it  probably  helps  the  respondent  to  express 
himself.  On  the -other  hand,  there  is  always  the  danger  that  it 
influences  and  even  biases  his  answers.  If  the  matter  at  stake 
is  a  very  simple  one,  the  advantages  are  greater  than  the  danger. 
The  respondent  who  is  asked  the  price  of  his  last  suit  and  checks 
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a  range  of  prices  which  goes  far  enough  below  and  above  the 
probable  price  will  hardly  be  influenced  by  such  a  check  list;  but 
when  it  comes  to  more  complicated  psychological  items,  it  might 
very  well  be  that  he  prefers  to  check  an  answer  corresponding 
only  partly  to  his  own  experience— rather  than  endeavor  to 
describe  accurately  what  he  feels. 

Jenkins1  has  given  considerable  time  and  thought  to  this 
problem  of  the  check  list  and  makes  a  very  important  point. 
His  conclusions  are:  if  the  check  list  is  exhaustive— if  it  really 
covers  all  the  replies  possible— then  the  danger  of  bias  is  not 
great;  but  if  the  check  list  is  incomplete— if  certain  possible 
replies  are  omitted— then  there  is  no  doubt  but  that  the  dis- 
tribution of  answers  is  heavily  influenced  by  it.  People  whose 
experience  is  not  covered  by  the  check  list  tend  to  check  some 
suggested  reply  instead  of  pointing  out  their  own  special  cases. 

The  soundness  of  a  check  list,  therefore,  lies  in  making  it  as 
exhaustive  as  possible.  The  best  way  to  insure  this  complete- 
ness is  first  to  put  the  question  without  any  check  list  before  a 
small  number  of  intelligent  respondents.  This  expedient  should 
provide  a  reasonable  number  of  the  possible  answers,  and,  even 
if  not  absolutely  complete  as  to  range,  it  should  be  sufficiently 
suggestive  to  enable  the  compiler  to  make  up  at  least  a  tentative 
list.  This  list  should  then  be  submitted  to  another  set  of  test 
respondents  with  the  request  that,  wherever  their  respective 
cases  are  not  specifically  covered  in  the  list,  they  should  each 
give  a  detailed  answer.  This  leads  usually  to  a  workable  revision. 
It  is,  nevertheless,  advisable  to  end  every  check  list  with  the 
heading— "  Others  (please  specify)  .  .  .  "—leaving  ample  space 
for  an  adequate  reply.  This  fairly  well  assures  the  inclusion 
of  any  items  which  may  have  been  overlooked  in  the  preparation 

of  the  list. 

This  technical  procedure  is,  of  course,  only  one  side  of  the 
story.  A  check  list  might  be  exhaustive  and  yet  not  satisfactory. 
The  following  list  is  quoted  from  a  recent  questionnaire: 

What  do  you  like  best  in  this  magazine: 

Articles  Aviation 

Stories  Television 

Short  Notices  Radio 

Advertisements 

1  Jenkins,  John  G.,  op.  cit. 
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The  items  of  this  check  list  manifestly  overlap.  One  can  be 
interested  in  articles  concerning  aviation  and  in  advertisements 
concerning  radio.  What  to  change  in  such  a  case  presents  a 
dilemma.  This  involves  the  problem  of  classification  which  will 
be  made  the  subject  of  a  special  chapter  later  in  this  work.  The 
essential  points  to  remember  about  check  lists  are  that  they  must 
be  exhaustive,  as  Jenkins1  proved,  and  in  addition  to  that  they 
must  comply  with  all  the  rules  of  psychological  classification 
which  will  be  presented  later  in  detail. 

Preparing  Successful  Interpretation 
by  the  Questionnaire 

Interpretation  is  the  most  important  contribution  which 
psychologists  can  make  to  market  research.  Two  whole  chap- 
ters of  this  book  will  be  found  devoted  to  it.  Anyone  who  works 
on  interpretation  knows  how  much  he  may  be  hampered  by  the 
mistakes  he  may  make  in  the  preparation  of  the  questionnaire 
or  in  the  classification  of  the  returns.  With  this  delay  and 
confusion  in  mind,  he  will,  from  the  beginning,  view  every  step 
in  the  light  of  facilitating  the  final  task  of  interpretation. 

As  a  means  of  preparing  the  ground  for  the  final  analysis  of 
results,  there  are  four  rules  which  should  be  kept  in  mind  in  the 
construction  of  questionnaires.     They  are : 

Avoid  empty  words. 

Prepare  as  much  as  possible  for  the  comparative  use  of  tables. 

Approach  the  topic  from  different  sides. 

Try  to  elicit  answers  which  are  psychologically  homogeneous. 

Avoiding  Empty  Words — the  Specifying  Question.  Respond- 
ents are  likely  to  use  words  which  contribute  no  information 
suitable  for  the  final  analysis.  If  they  are  asked  why  they  use 
a  certain  product,  they  may  say:  "I  like  it"  or  "It  is  good." 
Of  course!  They  would  not  use  the  product  at  all  if  they  did 
not  like  it  or  did  not  feel  that  it  was  good.  Such  an  answer, 
therefore,  does  not  help  the  interpretation  in  any  way.  The 
same  holds  true  where  a  book  is  described  as  "interesting." 
Such  empty  words  can  largely  be  avoided  by  properly  training 
the  interviewers;  but  the  questionnaire  itself  can  contribute  much 
by  what  are  called  "specifying  questions." 

1  Jenkins,  John  G.,  op.  cit. 
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If  the  pretest  of  a  questionnaire  indicates  that  a  great  number 
of  empty  words  might  be  employed  in  the  replies,  the  questions 
might  be  formulated  somewhat  like  the  following: 

"What  do  you  like  about  this  product?" 

If  the  reply  is  that  the  product  is  "good,"  "useful,"  etc.,  the 
interviewer  should  then  ask — 

"In  what  respect  is  it  good,  useful,  etc.?"     Here,  the  second 

is  a  specifying  question.  _  _ 

In  tabulating  the  returns,  these  two  questions  are  treated  as  a 
unit  Those  substantial  data  procured  with  the  help  of  the 
specifying  question  should  be  tabulated  as  if  they  were  glven 
directly  in  reply  to  the  primary  question.  The  specifying  ques- 
tion has  merely  a  subsidiary  function. 

The  importance  of  the  specifying  question  is  demonstrated 
also  when  certain  more  complex  features  of  a  commodity  are 
concerned.  Many  studies  have  been  spoiled  by  tabulations 
like  the  following-quoted  from  a  shoe  study  The  question 
was:  "What  is  most  important  in  a  good  shoe?'    and  the  mam 

replies  read : 

Its  color 
Its  fit 
Its  style 
Its  quality 

Now  color,  fit  and  style  are  attributes  which  can  be  recognized 
definitely  during  the  purchase,  and  the  words  themselves  are 
commonly  used  in  the  same  sense  by  all  of  the  respondents. 
But  how  about  quality?  Quality  cannot  be  percerved l- di- 
ately ;  it  has  to  be  inferred.  Many  people  may  mean  style  when 
they  say  quality  or  they  may  have  in  mind  some  c°mbmation  of 
the  items  listed  in  the  table  and  some,  perhaps  not  li rted.  A 
specifying  question  is,  therefore,  necessary-to  this  effect .  How 
do  you  "cognize  quality  in  buying  a  shoe?"  In  such  a  case 
two  tabulations  may  be  necessary,  one  introducing  quality  u i  a 
special  item,  the  other  resolving  quality  into  whatever ^etaneM 
may  be  brought  out  by  the  specifying  question.  The  first  table 
would  give  a  distribution  of  words-which  might  be  useful  for 
Topy  writing;  the  second  would  give  a  distribution  of  the  decisive 
features  of  the  shoe-which  might  be  more  useful  as  a  lead  for 
the  manufacturer. 
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Comparative  Questions.  Suppose  that  people  are  asked  why 
they  use  a  certain  brand  of  pineapple  juice.  Price  will  probably 
be  found  mentioned  less  frequently  than  its  actual  influence 
should  prompt.  Most  people  do  not  like  to  admit  price  as  a 
consideration  in  their  purchases  of  such  simple  things.  This 
reluctance  on  the  part  of  such  respondents  cannot  be  avoided,  but 
a  comparative  question  can  be  asked:  e.g.,  why  they  use  a  certain 
brand  of  tomato  juice.  Here  again  price  will  appear  less  often 
than  would  correspond  to  its  actual  importance.  But  the  com- 
parison of  the  two  results  will  show  with  which  product  price  is 
more  frequently  associated  and  might  lead  to  inferences  of  con- 
siderable importance. 

Many  other  instances  are  available  in  which  comparative 
questions  have  illumined  an  analysis,  to  the  great  betterment 
of  a  sfcidy.  One  might  want  to  learn  people's  ideas  of  what 
makes  a  good  salesman.  Few  respondents  have  given  any 
thought  to  this  subject;  their  answers  to  questions  along  these 
lines  would  be  purely  conventional.  It  is  a  good  rule,  therefore, 
to  ask  at  least  two  questions. 

If,  for  instance,  in  a  study  of  men's  suits  respondents  are 
asked:  "What  is  essential  in  a  good  salesman  of  men's  suits?" 
and  "What  is  essential  in  a  good  salesman  of  men's  shoes?"  the 
comparison  of  tables  resulting  from  two  such  questions  is  usually 
significant  and  constructive.  Based  upon  such  material,  a  very 
useful  system  of  essential  features  might  be  built  up  for  sales 
people  of  all  sorts  of  commodities. 

Another  example  of  the  use  of  the  comparative  question  is  in 
testing  the  influence  of  different  media  in  advertising.  If  we 
want  to  know  if  magazine  X  influences  a  respondent's  purchases, 
we  might  at  the  same  time  ask  him  the  identical  question  in 
regard  to  the  magazine  Y  which  we  know  he  also  reads.  Even 
if  our  respondents  have  a  tendency  to  conceal  the  influence  of 
advertising,  the  comparison  between  the  whole  returns  in  regard 
to  the  magazines  X  and  Y  will  be  very  revealing  for  X. 

It  is  a  test  of  the  ingenuity  of  the  investigator  in  every  new 
case  to  find  the  right  sort  of  comparative  questions.  The  main 
idea  behind  it  is  that  certain  factors  which  might  bias  the  reply 
to  a  question  drop  out  if  it  is  followed  by  a  comparative  question. 
It  then  becomes  possible  to  interpret  the  results  comparatively, 


78  THE  TECHNIQUE  OF  MARKETING  RESEARCH 

rather  than  in  an  absolute  sense,  and  the  whole  study  is  put  on 
much  safer  ground.1 

Approaching  Topics  from  Different  Sides.  This  is  just  an 
extension  of  the  idea  of.  the  comparative  use  of  tables.  It  is 
intended  to  stress  the  caution  that  every  problem  should  be 
approached  from  as  many  sides  as  possible.  The  influence  some 
questions  might  have  upon  the  reply  and  the  reluctance  respond- 
ents might  feel  to  discuss  certain  matters  often  lead  to  poor 
results  with  respect  to  some  feature  of  the  study.  If  an  entire 
study  is  not  to  be  spoiled  because  one  question  proved  a  "flop," 
provision  must  be  made  from  the  beginning,  for  different 
approaches  to  the  same  problem. 

Take,  as  an  example,  the  matter  of  the  decisive  attribute  of  a 
particular  commodity:  What  is  it  for  toothpaste?  Is  it  taste, 
consistency,  color  or  strength?  The  matter  of  the  decisive 
attributes  should  be  approached  several  times  in  the  one  inter- 
view. One  time  the  respondent  may  be  asked  directly  his  general 
opinion  about  it;  again,  he  may  be  asked  his  reasons  for  his  last 
purchase;  and  still  further  on,  he  may  be  asked  why  he  dropped 
the  brand  he  previously  used.  This  gives  three  approaches  to 
check  against  one  another. 

In  discussing  advertisements  or  salespeople,  the  same  situation 
arises.  Tables  drawn  from  the  different  psychological  situa- 
tions, revealed  by  several  varying  approaches,  may  furnish 
interpretative  material  of  considerable  value.  Sometimes,  too, 
purchases  in  other  lines  which  have  close  connection  with  the 
commodity  under  investigation  must  also  be  examined.  In  a 
coal  research,  for  instance,  one  should  discuss  stoves;  in  a  tire 
study,  cars;  in  a  stocking  study,  shoes,  etc. 

An  especially  good  example  of  an  item,  frequently  overlooked 
but  very  important  for  a  close  interpretation,  is  the  age  of  the 

i  By  now  it  will  have  become  clear  that  the  different  techniques  in 
questionnaire  making  and  the  different  psychological  considerations  which 
lie  behind  them  do  not  match  one  another  completely.  Many  techniques 
serve  several  psychological  means  at  the  same  time  and  many  psychological 
purposes  can  be  carried  through  only  on  more  than  one  technical  device. 
For  instance,  the  use  of  comparative  questions  has  been  mentioned  twice; 
once,  in  connection  with  helping  the  respondent  to  express  himself  and  now  m 
discussing  provisions  for  successful  interpretations.  In  the  same  way,  the 
check  list  was  discussed  once  in  connection  with-  avoiding  bias  and  will  be 
taken  up  again  in  detail  in  connection  with  the  psychology  of  classification. 
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respondent.  It  should  be  a  rule  always  to  estimate  the  respond- 
ents' age  as  nearly  as  possible  and  to  break  down  some  of  the 
answers  in  accordance  with  it.  Here  is  an  example  of  a  success- 
ful effort  of  this  kind.  In  a  rayon  study,  there  was  found  a 
pronounced  prejudice  against  this  textile,  although  many  of  the 
respondents  were  not  even  able  to  recognize  which  was  rayon  and 
which  was  silk.  The  question  then  arose  as  to  what  could 
account  for  this  prejudice.  Could  it  be  that  people  still  remem- 
bered the  bad  rayon  which  was  brought  on  the  market  some 
years  ago?  Or  was  it  that  people  dislike  the  idea  of  an  artificial 
product? 

The  answers  of  the  respondents  in  this  study  were  broken  down 
according  to  age  and  it  turned  out  that  the  younger  ones  were 
much  less  favorable  toward  rayon  than  were  the  older  ones. 
This  seemed  to  prove  that  it  was  not  a  bias  persisting  from  the 
early  bad  rayon  which  determined  the  prejudice.  If  it  were,  the 
older  women  would  have  been  the  ones  to  show  it.  Apparently, 
then,  a  reason  had  to  be  sought  that  would  especially  influence 
young  people.  Generally  speaking,  young  people  are  inclined 
to  have  very  rigid  ideas  about  things'  being  genuine.  It  is  only 
with  increasing  age  and  experience  that  women  are  likely  to 
appreciate  price  and  the  other  practical  aspects  of  commodities. 

In  view  of  this  generalization,  supported,  of  course,  by  other 
evidence,  it  becomes  fairly  clear  that  the  younger  generation's 
prejudice  against  rayon  lies  mainly  in  its  being  an  artificial  fabric. 

It  is  not  unusual  for  investigators  or  reporters  in  the  field  to 
resent  these  added  questions  as  superfluous.  In  the  long  run, 
however,  much  more  is  gained  from  the  broader  basis  so  provided 
for  interpretation  than  by  the  mere  cutting  out  of  a  question  or 
two  whose  bearing  is  not  immediately  evident.  This  whole 
subject  of  approaching  topics  from  different  sides  will  be  referred 
to  again  in  Chap.  XV. 

Making  Sure  That  Answers  Are  Homogeneous 
from  a  Psychological  Point  of  View 
In  asking  the  more  complex  questions,  there  is  always  a  danger 
of  obtaining  replies  which  sound  similar  but  which  have  actually 
very  different  psychological  significance.  If  an  individual  is 
asked:  "Why  don't  you  play  the  piano?"  he  will,  according  to 
his  previous  experience,  be  in  one  or  the  other  of  two  very  differ- 
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ent  psychological  situations.     If  he  has  considered  playing  the 
piano  and  has  not  carried  it  through,  for  one  reason  or  another, 
he  will  be  able  to  give  an  account  of  his  motives  for  not  playing. 
If  it  has  never  occurred  to  him  that  he  could  learn  to  play,  he 
will,  at  the  best,  say  so.     But  he  may  just  as  probably  make  up 
some   hasty   explanation   for   not   playing.     Such   an   artificial 
answer  will  serve  no  purpose.     It  should  be  well  distinguished 
from  the  replies  in  the  first  case,  which  may  be  of  great  impor- 
tance in  a  study.     To  obviate  possible  confusion  of  this  sort,  a 
preliminary  question  should  be  asked:  "Did  you  ever  consider 
playing  the  piano?"     The  best  thing  is  to  tabulate  only  the 
answers  of  those  people  who  reply  "Yes."     But  if  there  exists 
a  reason  for  tabulating  both  groups  of  answers,  they  should  be 
recorded  separately. 

The  necessity  for  distinguishing  between  these  two  types  ol 
replies  is  especially  important  wherever  a  negative  question  is 
asked.  One  might  make  it  a  general  rule  that  wherever  people 
are  asked  their  reasons  for  not  doing  something,  a  preliminary 
question  is  required  to  divide  respondents  into  those  who  have 
considered  the  action  and  who  are,  therefore,  likely  to  have 
reasons  and  those  others  who  have  never  considered  it. 

Even  in  positive  questions  an  insertion  separating  answers 
which  are  not  psychologically  homogeneous  is  necessary.  Take, 
for  instance,  the  matter  of  vacation  trips  and  visualize  the  ques- 
tion: "  Where  would  you  like  to  go  this  summer?"  Those  people 
who  are  likely  to  go  on  a  vacation  trip  will  report  their  actual 
plans.  Those  people  who  have  no  chance  to  leave  the  city  will 
answer  in  terms  of  their  daydreams.  Both  groups  of  replies 
might  be  equally  important  and  interesting  from  the  point  of 
view  of  a  given  study,  but  they  have  to  be  treated  separately 
because  they  have  very  different  psychological  implications. 
The  way  to  treat  them  separately  is  to  insert  the  question,  Will 
you  have  a  chance  to  go  on  a  summer  vacation  this  year?" 

i  The  reader  might  feel  that  such  a  warning  is  trivial  because  every  good 
research  man  is  aware  of  the  problem;  but  this  is  not  the  case.  An  agency 
of  the  Federal  government,  for  instance,  put  out  a  questionnaire  to  survey 
the  situation  of  young  people,  on  a  nationwide  scale.  One  of  the  ques- 
tions read,  "What  would  you  like  to  study?"  No  provision  was  made 
for  separating  those  who  actually  would  have  a  chance  to  study  from  those 
from  whom  that  question  would  elicit  only  a  dream.     It  is  against  precisely 
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Sometimes  it  may  even  be  necessary  to  prepare  different  ques- 
tions for  groups  which  differ  in  regard  to  the  psychological  sit- 
uations in  which  they  enter  the  market.  If  people  are  to  be 
interviewed  about  photographic  material,  different  questions 
would  certainly  be  required  for  those  who  make  photography 
their  steady  hobby  and  those  who  take  pictures  only  incidentally. 
In  the  same  way  different  questions  are  appropriate  for  those 
who  have  used  a  commodity  for  many  years  and  those  who  have 
just  started  using  it.  The  main  point  in  starting  a  study  is  to 
ask  if  the  respondents  will  be  psychologically  in  a  homogeneous 
situation  or  not.  If  there  is  reason  to  suspect  that  a  certain 
commodity  is  used  by  different  types  of  consumers,  a  pretest  of 
the  questions  must  be  made  and,  if  necessary,  special  questions 
must  be  inserted — in  order  to  separate  the  different  psychological 
groups;  and  different  questions  must  be  formulated  for  the  various 
types  of  respondents. 

This  requirement  of  maintaining  homogeneity  in  replies  leads 
to  some  well-known  problems  of  experimental  techniques.  As 
an  example  Link1  points  to  the  so-called  " recognition  tests"  for 
determining  the  effectiveness  of  advertising.  Here,  it  is  usual  to 
put  a  copy  of  a  magazine  in  front  of  a  reader  and  go  over  it  with 
him  page  by  page,  asking  him  which  of  the  advertisements  he 
has  read.  It  makes  a  great  difference  whether  the  magazine 
put  before  the  respondent  contains  a  hundred  pages  or  only 
twenty.  In  the  former  case,  the  mere  sight  of  the  volume  may 
make  him  impatient  and  induce  him  to  much  shorter  and  more 
superficial  scrutiny  than  in  the  latter  case.  Readers  of  maga- 
zines of  different  sizes  are,  during  the  test,  in  psychologically 
different  situations,  although  the  procedure  followed  and  the 
questions  asked  are  the  same  in  both  cases. 


this  that  the  reader  should  be  warned.     A  simple  insertion,  ''Will  you  have  a 
chance  to  study?"  preceding  the  question  of  what  they  wanted  to  study 
would  have  made  the  question  specific. 
1  Link,  Henky  C,  op.  cit. 


CHAPTER  IV 

FURTHER  CONSIDERATION  OF  PSYCHOLOGICAL 
ASPECTS 

There  is  one  section  in  every  questionnaire  which  is  more  a 
psychological  matter  than  is  any  other  part;  that  is,  where  the 
respondents  are  asked  for  reasons.  Research  men  disagree  as 
to  the  value  of  such  questions  and  some  hold  that  they  should 
not  be  used  at  all.  Experience  seems  to  justify  this  difference  of 
opinion.  There  are  relatively  few  cases  in  which  market  studies 
have  successfully  used  a  request  for  reasons.  A  detailed  analysis 
of  this  circumstance  shows  that  the  fault  lies  not  with  the  prob- 
lem, but  with  the  investigator.  There  is  a  right  way  of  asking 
"Why?"  which  yields  very  important  results  and,  if  properly 
applied,  may  make  this  part  of  the  questionnaire  a  most  powerful 
tool  of  research.  For  that  reason  this  special  section  is  devoted 
to  the  subtleties  of  asking  "Why?"1 

The  Art  of  Asking  "Why?"     In  order  to  get  a  respondent  s 
reasons  for  his  purchase,  several  points  have  to  be  kept  in  mind. 
The  first  step  is  to  realize  that  a  purchase  has  not  one  reason  but 
a  great  many.     We  first  feel  a  need  for  something— aroused, 
perhaps  by  some  external  incident;  then  we  look  for  information; 
and  every  bit  of  advice  we  get  or  of  advertising  that  we  see  or 
hear  enters  in  some  degree  into  our  final  determination  to  pur- 
chase.    Then,  at  the  time  the  need  manifests  itself,  there  are 
certain  considerations,  predilections  and  habits  of  our  own  which 
become  factors  in  our  decision.     Finally,  the  supply  m  the  mar- 
ket, window  displays,  the  proximity  of  the  store  or  the  personality 
of  the  salesman  might  contribute  to  the  final  decision.     Obvi- 
ously, there  can  be  no  one  reason.     There  are  many  reasons. 
Therefore,  if  we  ask  for  the  reason  we  can  certainly  get  no  sensible 
result. 

iThe  content  of  the  following  paragraphs  is  a  brief  survey  of  a  rather 
extensive  analysis  by  Dr.  Paul  Felix  Lazarsfeld;  "Art  of  Asking  Why 
National  Marketing  Review  (National  Association  of  Marketing  Teachers), 
Business  Publications,  Inc.,  Chicago,  Summer,  1935. 
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The  next  step  is  to  be  aware  that  all  of  these  reasons  permit  a 
fundamental  classification.  Every  one  of  them  belongs  to  one 
of  three  clearly  defined  groups: 

First — All  of  an  individual's  own  purposes,  attitudes  and  pre- 
dilections, which  might  determine  a  purchase,  belong  to  the 
great  group  of  tendencies. 

Second — Any  piece  of  advertisement  or  advice,  any  display 
which  steers  the  individual's  shopping,  belongs  to  the  great  group 
of  influences. 

Third — Any  feature  of  the  commodity  itself,  its  color,  shape, 
price,  package,  etc.,  which  might  prompt  a  purchase,  belongs  to 
the  great  group  of  attributes. 

The  reasons  for  any  purchase,  therefore,  can  be  classified 
into  tendencies,  influences  and  attributes  and  any  number  of 
reasons  in  each  class  may  be  involved  in  any  one  purchase. 

This  classification  has  a  very  great  importance  in  the  whole 
technique  of  asking  " Why?"  It  is  demonstrable  that  there  is  no 
purchase  which  would  not  necessarily  be  determined  by  at  least 
one  factor  from  each  of  these  three  groups.  In  order  that  a  purchase 
should  be  even  considered,  something  like  a  need  has  to  be  opera- 
tive; that  provides  a  tendency.  In  order  even  to  consider  pur- 
chasing a  product,  some  advertising  or  the  product  itself  must 
have  been  seen  somewhere;  that  provides  an  influence.  In  order 
to  buy  a  product,  there  must  be  at  least  some  one  feature  which 
makes  it  suitable  for  the  purchaser;  that  provides  the  attribute. 
While  there  might  be,  of  course,  several  determinants  in  each 
group,  at  least  one  reason  from  each  class  is  inevitably  present. 

It  makes  very  good  psychological  training  for  market  research 
men  to  go  through  their  own  individual  purchases  and  see  how 
these  three  groups  of  determinants  combine  in  the  most  varied 
ways  to  shape  the  consumer's  activities  in  the  market.  There 
is  no  space  here  to  go  into  more  details,  but  the  reader  is  strongly 
advised  to  corroborate  this  principle  by  testing  his  own  experience. 

The  practical  use  of  such  a  classification  appears  in  the  third 
step  of  this  analysis.  Now  we  have  to  decide  what  we  actually 
want  to  find  out  in  asking  "-Why?"  Suppose  that  a  housewife 
is  asked  why  she  uses  a  certain  brand  of  soap.  She  might  under- 
stand the  interviewer  as  wanting  to  know  what  influences  made 
her  buy  the  brand  and  then  she  will  report,  say,  "the  dealer's 
advice."     Or,  she  might  understand  the  interviewer  as  wanting 
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to  know  what  attributes  of  the  soap  made  this  brand  commend- 
able and,  then,  she  might  report,  say,  that  "it  lathers  freely. 

Now  suppose  a  dealer  advised  two  different  women  to  buy  X 
soap  because  it  lathers  freely  and,  then,  suppose  both  women 
are  asked  "  Why  did  you  buy  this  brand  of  soap?  One  might 
report  that  the  dealer  advised  her  and  the  other,  that  the  soap 
lathers  well.  This  would  indicate  clearly  that  the  former  under- 
stood the  question  -Why?"  to  pertain  to  influences,  the  latter, 
to  attributes.     Two  identical  cases  might  thus  give  two  quite 

different  returns. 

A  general  rule  governing  the  formulation  of  such  questions 
might  be  stated  thus:  the  question  "Why?"  has  to  be  asked  m 
such  a  way  as  to  admit  of  no  doubt  in  the  mind  of  the  respondent 
concerning  the  group  of  determinants  to  which  it  pertains.  If  we 
are  interested  in  influences  we  might  ask:  "What  made  you  start 
using  this  brand?"  If  our  concern  is  with  attributes,  we  might 
ask-  "What  are  the  advantages  of  the  soap  you  use?"  Experi- 
ments have  shown  the  practical  importance  of  thus  qualifying 

the  question  "Why?"  . 

Two  otherwise  comparable  groups  of  housewives  were  asked, 
in  both  ways  outlined  above,  the  reasons  for  their  buying  differ- 
ent commodities.     Below  is  the  table  of  the  replies  which  were 
obtained  in  regard  to  cereal. 
Group  I.  Question:  Why  do  you  use  this  brand?  ^ 

Main  Returns  (Confusing  Attributes  and  Influences)  Cent 

Quality 15 

Price ^0 

Dealer y 

Package 16 

Sundry  inconsequential  reasons 

Advertisements • 

100 

Group  II.  Question:  What  led  you  first  to  buy  this  brand?  ^ 

Replies  (Focusing  the  Respondent  on  Influences  Alone)  Cent 

Dealer  advice 24 

Advertisement ^ 

Other  recommendations 7 

Sundry  inconsequential  reasons 

Does  not  know 

100 
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Apparently,  when  we  ask  only  "  Why?"  as  in  Group  I,  there  is 
a  tendency  among  housewives  to  interpret  the  question  as  per- 
taining to  attributes  rather  than  to  influences.  Advertising, 
as  an  influence,  shows  up  very  poorly.  When  we  make  it 
quite  clear,  however,  that  we  want  to  know  influences,  as 
in  Group  II,  the  index  for  advertising  jumps  from  2  to  24 
per  cent. 

A  good  way  to  put  the  matter  is  to  say:  "  The  word  'why'  is  not 
a  question  but  a  program."  It  means  that  the  investigator  must 
purposefully  seek  the  determinants  of  a  purchase.  In  order  to 
transform  this  program  into  questions,  a  clear  concept  of  per- 
tinent groups  of  determinants  must  first  be  arrived  at.  Then 
the  questions  must  be  formulated  to  evoke  the  desired  type  of 
response. 

Here  are  a  few  more  examples  of  this  very  important  pro- » 
cedure. 

Take  the  question:  "Why  did  you  change  your  brand  of 
gasoline  ?"  The  respondents  are  free  to  understand  that  the 
interviewer  wants  to  know  either  what  they  disliked  about  the 
old  brand  or  what  attracted  them  to  the  new  one.  They  may 
give  answers  which  are  quite  incomparable.  To  procure  useful 
returns,  the  broad  program  must  be  reduced  to  specific  questions : 
"Why  did  you  leave  your  old  brand?  Why  did  you  select  your 
new  one?" 

Depending  upon  the  details  desired,  the  questions  may  or 
may  not  end  here;  if  further  classification  is  essential,  addi- 
tional questions  may  be  asked  dealing  separately  with  influ- 
ences and  attributes.  The  decision  regarding  the  details  desired 
is  closely  connected  with  problems  of  interpretation  and  will  be 
more  fully  discussed  in  Chap.  XV. 

Another  example:  "Why  do  you  subscribe  to  the  Magazine  X?" 
Some  respondents  might  answer  this  question  with  a  statement 
as  to  what  they  like  about  the  magazine.  Others  might  tell 
the  interviewer  how  they  learned  about  it.  In  order  to  avoid 
confusion  in  the  returns,  it  must  be  determined  in  advance  what 
is  most  important  for  the  purpose  of  the  study.  If  advice  con- 
cerning the  editorial  policy  is  sought,  the  attributes  of  the  maga- 
zine are  most  important;  if  information  affecting  the  circulation 
department  is  desired,  the  influences  are  the  center  of  interest. 
The  influences  in  this  special  case  may  lead  to  a  further  important 
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distinction.  Actual  case  analyses  show  that  subscribing  to  a 
magazine  is  very  often  not  a  quick  decision.  First  an  interest 
in  it  is  aroused;  then  it  takes  some  time  before  the  decision  to 
subscribe  is  formed.  For  determining  the  factors  which  lead  to 
a  subscription,  therefore,  two  questions  might  be  asked:  "How 
did  you  first  learn  about  Magazine  X?"  "On  what  occasion 
did  you  finally  decide  to  subscribe  to  Magazine  X?" 

As  a  last  illustration  let  us  take  the  reasons  for  book  buying. 
The  program  is  to  find  out:  "Why  did  you  buy  this  book?"     A 
single  respondent  will  give,  out  of  the  same  concrete  experience, 
quite  different  answers,  according  to  the  particular  word  stressed: 
"buy,"  "this,"  or  "book."     If  he  understood:  "Why  did  you 
buy  this  book?"  he  might  answer— "  Because  the  waiting  list  in 
the  library  was  so  long  that  I  could  not  have  obtained  it  for  two 
months."     If  he  understood:  "Why  did  you  buy  this  book?"  he 
might  tell  what  interested  him  especially  in  the  author.     And  if 
he  understood,  "Why  did  you  buy  this  book?"  he  might  report 
that  at  first  he  had  intended  to  spend  the  money  on  a  concert 
ticket,  but  finally  decided  upon  a  book  because  he  realized  that 
a  book  is  a  much  more  enduring  possession.     If  the  study  is 
undertaken  for  a  publishing  company  which  wants  to  be  in  a 
better  position  to  compete  with  libraries,  the  questions  will  have 
to  stress  the  buying  aspect  as  opposed  to  all  other  methods  by 
which  a  book  may  be  acquired.     If  a  library  wants  to  find  out  the 
books  in  which  people  are  most  interested,  the  characteristics 
of  books  will  need  more  emphasis  in  the  questions.     If  the  survey 
is  a  leisure-time  study,  it  will  be  necessary  to  stress  all  questions 
which  pertain  to  book  reading  in  comparison  with  other  means  of 
entertainment.     There  is  actually  no  element  of  a  concrete  pur- 
chase experience  which  cannot  be  made  the  object  of  a  specified 
"why"  question  for  a  general  "why"  program. 

One  of  the  most  fundamental  steps  in  improving  any  market 
study  is  the  development  of  this  technique  of  asking  "Why?" 
To  realize  that  every  purchase  has  many  reasons;  to  know  that 
these  reasons  permit  a  fundamental  classification  into  tendencies, 
influences  and  attributes;  to  be  aware  that  the  purpose  of  a 
study  determines  in  which  group  of  reasons  the  interest  should 
be  centered  and  to  be  able  to  formulate  special  questions  to  pick 
out  the  group  of  reasons  really  desired.     In  this  sequence  lies 
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one  of  the  main  contributions  which  psychology  can  make  to 
market  research. 

Technical  Miscellanies.  There  are  now  several  problems  left 
which  pertain  to  the  technical  handling  of  the  questionnaire  more 
than  to  the  specific  wording  and  arrangement.  Only  the  per- 
sonal interview  has  so  far  been  considered  and  nothing  has  been 
said  of  the  mailed  questionnaire.  This  topic  has  been  delib- 
erately deferred  because  it  is  generally  felt  that  the  mailed  ques- 
tionnaire should  be  used  as  little  as  possible. 

Self-selection  of  Respondents.  Sometimes  there  are  ways  to 
formulate  a  mailed  questionnaire  which  will  be  so  clear  and 
simple  that  the  returns  will  be  about  as  good  as  the  returns  of 
a  personal  interview.  But  there  is  one  uncontrollable  factor — 
self-selection  of  the  respondent.  In  general,  it  is  assumed  that 
about  10  per  cent  of  the  people  who  receive  mailed  question- 
naires return  answers.  In  some  cases  the  special  interest  of  the 
topic  increases  the  number  of  respondents.  In  any  case,  it  is 
probable  that  the  persons  who  reply  have  a  special  interest  in 
the  topic  and,  therefore,  are  not  representative  of  the  whole 
group. 

By  personal  interview  housewives  were  questioned  as  to  their 
attitude  toward  advertising.  Simultaneously  the  same  ques- 
tionnaire was  mailed  out  to  its  subscribers  by  a  large  woman's 
magazine.  From  the  respondents  interviewed  in  person  the 
replies  of  all  those  who  were  subscribers  to  this  woman's  magazine 
were  segregated.  That  made  it  possible  to  compare  a  random 
sample  of  the  magazine's  subscribers  with  another  sample  which 
had  selected  itself  by  returning  the  mailed  questionnaire.  It 
developed  that  the  latter's  attitude  toward  advertising  was  very 
much  more  favorable  than  that  of  the  directly  interviewed  group. 
Apparently,  the  women  who  had  answered  the  mailed  question- 
naire were  those  who  had  already  acquired  a  favorable  attitude 
toward  advertising  and  who  were,  therefore,  more  susceptible  to 
the  magazine's  request  for  a  reply. 

In  another  study,  a  check  by  direct  interview  was  made  of  the 
brand  of  toothpaste  used  by  every  individual  to  whom  the  ques- 
tionnaire had  been  mailed.  It  developed  that  almost  all  those 
who  had  returned  the  mailed  questionnaires  were  actually  users 
of  the  brand  under  consideration  and  since  " users"  alone  could 
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by  no  means  represent  the  whole  market,  the  results  of  the  mailed 
questionnaire  were  palpably  unsound. 

Unfortunately,  this  problem  of  self-selection  does  not  disappear 
completely  even  in  personal  interviews.  If,  for  instance,  people 
are  canvassed  from  door  to  door,  some  of  them  will  not  be  found 
at  home.  It  is  very  probable  that  they  represent  a  special  group ; 
for  instance,  they  are  wives  who  go  to  work  or  wives  who  have 
no  children  and  therefore  stay  less  at  home.1 

Even  if  we  find  all  the  people  at  home,  some  will  refuse  to 
answer.  It  might  well  be  that  these  are  people  who  have  a 
special  attitude  toward  the  problem  being  investigated.  People 
who  are  too  captious  to  answer  an  interviewer  might  have  other 
food  preferences,  for  instance,  than  people  of  a  more  genial  tem- 
perament. It  is  not  possible  to  avoid  such  self-selection  in  every 
case  but  it  is,  at  least,  advisable  to  make  notes  about  every 
refusal,  so  that  the  problem  can  be  considered  when  it  comes  to 
the  final  interpretation. 

Inducing  Respondents  to  Comment.  Another  factor  which 
should  not  be  underestimated  is  the  distribution  of  space  in  a 
questionnaire.  Let  us  consider  first  an  example  from  ques- 
tionnaires filled  in  by  the  respondent  directly.  The  Eastman 
Kodak  Company  distributed  at  the  Chicago  World's  Fair  (1933- 
1934)  a  questionnaire  regarding  photographic  interests.  At  the 
end  of  the  questionnaire  the  usual  request  was  made  that  the 
respondent  should  add  any  free  comments  he  felt  were  important. 
More  than  20,000  questionnaires  were  returned.  Some  of  the 
questionnaires  had  only  three  lines  of  space  and  some  others  had 
five  lines;  of  those  with  less  space,  only  8  per  cent  contained  free 
remarks;  among  those  with  more  space,  however,  13  per  cent  were 
filled  in  at  this  point.  This  indicates  that  the  amount  of  space 
available  has  a  very  definite  influence  upon  the  disposition  of  the 
respondent  to  make  remarks. 

There  is  no  doubt  that  the  same  holds  true  for  direct  inter- 
views when  reported  by  the  interviewer.     Experience  has  shown 

i  Link  has  pointed  out  that  this  factor  plays  an  important  role  in  tests 
to  determine  readers'  interest.  The  predilections  for  certain  magazines 
expressed  by  women  found  at  home  might  be  different  from  the  predilections 
which  those  women  who  have  jobs  outside  might  have  expressed  had  they 
been  at  home  when  the  interviewers  called.  Absence  and  interest  probably 
have  an  interconnection  and  in  some  studies  it  may  be  of  great  importance. 
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that  an  interviewer  will  make  a  more  elaborate  note  if  he  has 
more  space  at  his  disposal.     Ample  space  should,  therefore,  be 
provided  for  comments,  especially  for  questions  likely  to  result  > 
in   a   somewhat   narrative   reply. 

For  similar  reasons,  it  is  generally  a  good  idea  to  leave  space 
for  the  interviewer's  remarks  about  the  respondent  and  the 
interviewing  situation.  Sometimes  the  interviewer  learns  impor- 
tant things  which  do  not  fit  into  any  particular  section  of  the 
questionnaire.  He  will  report  such  personal  findings  only  when 
special  space  is  provided  for  his  remarks. 

Adequate  Organization.  Here  is  the  opportunity  to  point  out 
that  the  interviewer  must  always  be  kept  in  mind  as  a  factor 
influencing  returns.  Not  only  is  it  found  that  some  interviewers 
procure  on  the  average  many  more  and  fuller  replies  than  others 
but  that  every  interviewer  has  a  preference  for  certain  words. 
Several  checks  show  that  certain  terms  appear  in  some  inter- 
viewers' reports  much  more  frequently  than  mere  probability 
could  account  for.  To  a  certain  degree,  this  can  be  avoided  by 
cautioning  the  interviewer  to  report  as  textually  as  possible. 
However,  the  best  safeguard  is  to  have  a  sufficient  number  of 
interviewers. 

It  is  probable  that  if  one  interviewer  makes  too  many  inter- 
views in  one  study  his  reports  become  more  and  more  stereotype. 
Sometimes  the  point  is  made  that  having  too  many  interviewers 
tends  to  make  the  reports  less  comparable.  This  danger  is 
certainly  less  than  the  effect  of  the  interviewer's  psychological 
exhaustion  if  he  has  too  many  calls  to  make.  It  is  not  possible 
to  give  definite  figures,  but  there  is  a  widespread  feeling  that  for 
about  one  hundred  interviews  made  in  one  place,  at  least  three 
interviewers  should  be  used;  for  five  hundred  interviews,  at 
least  ten;  and  for  one  thousand  interviews,  not  less  than  fifteen.1 
Pretesting.  It  is  appropriate  to  close  these  notes  with  some 
comments  on  the  matter  of  pretesting  and  retesting  questionnaires. 
However  much  we  know  about  making  a  questionnaire  every  new 
concrete  research  problem  will  put  before  us  new  difficulties. 
Therefore,  it  is  extremely  important  to  submit  every  question- 
naire to  several  trials  before  using  it  finally.  The  best  procedure 
is  to  discuss  the  subject  first  with  a  few  respondents  and  just 
i  For  a  larger  study,  the  number  of  interviews  per  field  worker  may  be 
increased,  because  then  there  is  more  time  available. 
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take  a  narrative  record  of  what  they  say.     Ten  or  fifteen  such 
narrative  records  will  make  it  possible  to  formulate  a  tentative 

qUTShisnquestionnaire  should  then  be  submitted  to  twenty  or 
thirty  respondents-a  procedure  which  should  offer  a  somewhat 
different  approach  to  the  problem.  On  the  basis  of  these  new 
returns  many  corrections  will  probably  be  necessary.  Even 
when  it  is  felt  that  the  form  has  reached  its  final  state,  tne 
questionnaire  should  be  submitted  to  still  another  test  group  of 
at  least  ten  people  before  the  form  is  mimeographed  or  printed. 
No  questionnaire  should  be  used  which  has  not  been  pretested 
in  its  final  form,  as  well  as  in  its  preceding  editions. 

In  the  course  of  this  presentation  so  far  several  problems  have 
been  suggested  which  make  pretesting  indispensable.  If  certain 
parts  of  a  tentative  questionnaire  remain  blank  m  several  tests 
that  may  indicate  only  that  the  respondent  has  difficulties  of 
expression.  But  it  may  mean,  among  other  things,  that  the 
order  of  the  questions  does  not  fit  into  the  order  of  his  experience 
and  therefore  upsets  his  memory.  In  order  to  find  out  where  the 
mistake  is,  it  is  essential  actually  to  talk  with  the  test  respond- 
ents and  ask  them  how  they  felt  about  the  questionnaire  m 
filling  it  in  That  is  especially  important  in  avoiding  ambiguous 
questions.  Test  respondents  should  always  be  given  an  oppor- 
tunity to  ask  how  a  particular  question  is  meant. 

The  Psychological  Corporation  reports  interviewing  dealers 
for  the  purpose  of  comparing  the  value  of  different  advertising 
media.  The  study  was  sponsored  by  a  radio  company  because 
there  was  a  justifiable  hope  that  radio  would  prove  to  be  the 
strongest  medium.  Under  these  circumstances  the  danger  ot 
bias  was  especially  great.  In  order  to  be  sure  that  the  wording 
of  the  questionnaire  was  judicious,  the  corporation  showed  the 
final  questionnaire  to  a  large  number  of  dealers  and  asked  them 
to  state  which  advertising  medium,  in  their  opinion,  was  inter- 
ested in  the  study.  As  not  one  dealer  referred  especial y  to 
radio,  the  danger  of  bias  proved  to  have  been  satisfactorily 

^Pretesting  not  only  helps  to  avoid  mistakes  but  it  very  often 
leads  to  new  ideas.  Often  during  tentative  interviews  respond- 
ents bring  up  angles  which  had  not  been  considered  at  all.  in 
a  study  regarding  the  influence  of  the  advertising  in  a  certain 
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magazine  upon  its  own  readers,  one  respondent,  in  a  narrative 
report,  volunteered  that  he  had  looked  for  a  certain  food  adver- 
tisement in  that  magazine  and  had  not  found  it.  This  comment 
prompted  the  question:  "Did  you  ever  look  in  this  magazine  for 
an  advertisement  which  was  not  there?"  This  question  had  not 
been  thought  of  before,  but  it  proved  very  important.  In 
almost  every  study  some  similar  instances  arise  to  indicate  that 
frequently  test  respondents  actually  do  make  contributions  of 
real  value  to  the  general  approach. 

Last,  but  not  least,  the  pretesting  helps  to  expose  pitfalls  in 
verbal  expression  which  might  prove  disastrous  in  later  classifica- 
tion. In  speaking  with  women  about  cosmetics,  many  respond- 
ents will  say  that  it  is  very  important  for  a  good  lipstick  to  last 
long.  What  do  they  mean?  Should  a  lipstick  be  economically 
used  and  therefore  last  many  weeks,  or  should  it  be  indelible 
and  last  for  hours  after  application?  Such  difficulties  of  under- 
standing must  be  established  during  the  pretest  and  the  inter- 
viewers cautioned  to  make  sure  of  the  sense  in  which  each  word 
is  used. 

.  The  technique  of  pretesting  is  in  a  rather  nebulous  state  so  far. 
A  more  exact  system  would  be  a  very  helpful  contribution  to  the 
progress  of  market  research.  It  is  something  that  should  come 
in  time. 


< 

I- 

<  _ 

Q  42 

Q 

L-  "I 

O  8 


0 

Q. 

— 

a; 

h- 

a> 

0 

a 

III 

rH 

J 

a. 

J 

0 

0 

i 


i 


g  -g 

s < 

<       01 


J  TT.TT 


<. 

< 

Q. 

■o 

O 

ox: 

CO 

o 

°>  < 


CHAPTER  V 

COLLECTION  OF  DATA 
PART  1.     DEVELOPED  OR  RECORDED  DATA 

(As  Presented  in  Chart  E) 

The  collection  of  data  is  the  foundation  of  all  research  work 
in  any  field.  It  is  the  bringing  together  of  the  material  to  be 
studied  and,  in  marketing,  it  is  the  first  stage  in  the  execution  of 
a  research  program.  It  is  a  critical  stage,  too.  The  insight  and 
discretion  with  which  sources  are  found  or  chosen ;  the  thorough- 
ness with  which  they  are  canvassed  or  examined;  the  integrity, 
the  intellectual  honesty,  with  which  data  are  brought  into 
consideration;  the  judgment  and  fidelity  with  which  they  are 
adapted  to  the  purpose  of  the  study — all  determine  the  validity 
of  the  finished  work.  Without  these  qualities  and  all  others 
leading  to  precision,  fullness  and  truth,  there  can  be  no  such 
thing  as  competent  research. 

Because  there  are  material  differences  in  technique,  distinc- 
tions are  necessarily  made  between  data  which  are  developed  or 
recorded  and  those  which  are  not.  For  the  same  reason  the 
process  of  collecting  data  by  individual  action  and  by  group 
action  are  also  treated  in  separate  sections. 

By  Individual  Action 

The  collection  of  recorded  data  by  individual  action  entails 
little  formal  technique.  It  is  the  simplest  of  the  several  processes 
and  is  largely  a  matter  of  knowing  and  deciding  just  where  to 
look  for  significant  material.  Its  procurement  for  purposes  of 
study  involves  a  reasonable  equipment  of  such  personal  charac- 
teristics as  industry,  persistence  and  common  sense,  and  a 
pleasing  and  effective  faculty  for  asking  questions  either  in 
person  or  by  correspondence. 

Under  this  heading,  therefore,  will  be  outlined  the  sources 
from  which  data  already  recorded  may  be  procured  as  part  of  the 
normal  executive  routine.     The  caption  "By  Individual  Action" 

93 
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ta  to  be  considered  not  solely  as  relating  to .the  number  of  persons 
engaged  but  rather  as  indicating  a  type  of  material.  It  is  infor- 
mation of  such  character  as  may  be  drawn  directly  from  its 
Turce  ana  as  may  be  applied  to  the  study  substantially  in  the 

f0rTherLVesduch  a  vast  fund  of  recorded  data,  covering  -ha 
wide  range  of  subjects  that  it  is  obviously  mefficxent  to  start 
Electing  new  material  without  having  first  exhausted  all  the 
x  t  ng  sources.*  It  is  also  wasteful,  because  a  careful  survey 
of  the  field  of  information  already  assembled  may  obviate  a  dupli- 
cation of  effort  and  materially  reduce  the  cost  of  a  study. 

While  it  will  be  impracticable  to  include  here  any  itemized  list 
of  sources  that  could  apply  to  all  the  many  kinds  o  marketing 
problems  in  all  the  various  industries,  the  following  classification 
of  the  major  sources  will  indicate  those  which  are  commonly 
referred  to  in  most  marketing  studies. 

Data  by  Purchase.  Some  organizations  make  ab^f 
collecting  data  and  preparing  reports,  which  they  offer  for  sale. 
Examples  of  sources  of  this  type  are: 

Dun  &  Bradstreet's  Credit  Rating  Books 
Harvard  Economic  Society 
Standard  Statistics  Service 

Babson's,  Brookmire's,  Moody's  and  similar  services 
Media  Records,  Inc. 
Poor's  Manual 

Thomas'  Registers  (several  lines) 
Who's  Who  Books 
Standard  Rate  &  Data  Service. 
The  Department  of  Commerce  publishes,  under  the  title  of 
Market  Research  Sources,  a  list  of  marketing  material  availab  e 
from   innumerable    different    organizations    and   group     whose 
activities  include  the  assembling  of   data  significant  m     heir 
respective  fields.     The  latest  issue  of  Market  Research  Sources 
w  s  Pub  ished  in  1936.     This  publication,  while  not  entirety 
list actory,  is  a  primary  source  of  information  and  should  be 
among  the  first  consulted  on  almost  any  marketing  problem 

Data  by  Exchange  or  Solicitation.  Frequently,  one  can  obtain 
material  regarding  the  individual  experiences  of  companies  com- 

.  For  a  condensed  but  practical  list  of  sources  see:  Cour^r,  Fh «*£, 
and  J.  Russell  Doubman,  Simplified  Market  Research,  pp.  43-83,  Walther 
Printing  House,  Philadelphia,  1935. 
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posing  associations,  or  a  number  of  companies  in  a  group,  by 
offering  each  contributor  a  report  on  the  combined  data,  analyzed 
and  arranged  for  his  own  use  and  benefit.  For  example,  the 
effect  of  premiums  and  prizes  in  the  grocery  trade  was  of  such 
interest  to  manufacturers  who  had  tried  those  promotional 
devices  that  a  simple  inquiry  brought  from  them  a  wealth  of 
information;  when  coordinated  and  interpreted,  the  collective 
experience  was  of  equal  value  to  all  of  the  manufacturers.  Such 
exchanges  of  experience  are  frequently  possible  either  as  an  end 
in  itself  or  as  a  basis  for  further  study. 

Among  the  common  sources  of  such  material  are  the  university 
schools  of  business  and  research  bureaus,  trade  associations, 
chambers  of  commerce,  real  estate  and  other  trade  boards,  tech- 
nical societies,  newspapers  and  magazines. 

Data  by  Library  Research.  This  type  of  research  will  yield 
material  too  varied  and  voluminous  to  admit  more  than  an 
indication  here.  Although  not  all  communities  provide  what  is 
commonly  termed  a  "  Commercial  Library,"  devoted  to  business 
and  economic  interests,  an  immense  amount  of  material  on  any 
given  subject  may  be  found  in  practically  all  public  libraries — 
especially  those  in  the  larger  cities.  The  public  library  in 
Newark,  New  Jersey,  is  an  example  of  what  can  be  accomplished 
in  cities  of  moderate  size.  The  libraries  of  schools  of  business 
attached  to  large  universities  have  probably  the  best  collections 
of  business  books  to  be  found  anywhere.  One  may  find  in  them 
as  many  as  50,000  or  100,000  volumes;  files  of  trade  publications 
and  special  periodicals  running  back  many  years;  innumerable 
theses  meticulously  covering  many  subjects  and  not  available  in 
print ;  and,  usually,  a  wide  assortment  of  publications  emanating 
from  the  Federal  government.  Many  advertising  agencies,  too, 
and  some  large  banking  and  commercial  institutions  maintain 
their  own  business  libraries  and,  as  a  rule,  are  quite  generous  to 
accredited  research  people. 

One  of  the  most  important  advantages  offered  by  a  library  is 
the  opportunity  to  trace  the  trends  of  various  businesses  by 
studies  of  the  files  of  magazines  over  extended  periods. 

Upon  application,  most  magazines  of  a  general  business  nature 
will  furnish  a  complete  bibliography  of  articles  and  data  relating 
to  specific  problems  in  their  respective  industries.  Since  these 
business  magazines  frequently  publish  actual  experience  stories, 
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as  well  as  the  more  general  analyses  of  trade  conditions,  a  search 
of  their  files  is  of  utmost  importance.  Such  magazines  as  Sales 
Management,  Prinlcrs' Ink,  Advertising  and  Selling  Business 
Week  Nation's  Business,  Forbes,  United  States  Daily,  Advertising 
Aae  etc  all  have  in  their  files  references  to  almost  any  kind  of 
problem*  almost  any  kind  of  business.  Although  these  maga- 
zines are  usually  available  through  public  or  private  libraries 
where  references  will  be  found  through  the  index  of  Readers 
Guide  to  Periodical  Literature,  almost  all  of  them  have  catalogues 
of  their  own  articles  which  can  freely  be  consulted  by  interested 

PeThevarious  trade  magazines,  of  which  there  are  several  hun- 
dred should  always  be  referred  to  in  connection  with  researches  in 
their  own  fields.  Not  only  are  they  able  to  furnish  many  general 
data,  presented  in  their  editorials  and  special  articles  but,  since 
they  are  serving  particular  industries,  they  have  available  usually 
a  fund  of  marketing  information  relating  authoritatively  to  those 
industries.  For  instance,  it  is  possible  generally  to  obtain  from 
trade  publications  estimates  of  numbers  and  even  locations  of 
distributors  and  retail  outlets;  data  on  the  trends  of  individual 
products,  material  on  the  standing  of  brands  in  different  market- 
ing areas,  the  development  of  new  types  of  outlets,  histories  of 
the  -rowth  of  various  industries,  data  on  the  relative  importance 
of  companies  in  any  given  industry  and  on  almost  any  such 

cognate  matter.  .,'■,,',      •  j:„+„ 

This  material  is,  in  some  instances,  available  for  immediate 
use;  in  other  cases  it  may  require  some  additional  research  to 
adapt  it  to  specific  studies.     In  practically  all  cases,  however 
trade  magazines  willingly  give  assistance  to  researches  jjte 
respective  fields  and  frequently  they  have  studies  of  their  own 
to  which  access  may  be  had.     Trade  magazines  are   therefore 
an  important  source  of  material,  except  where  they  tend  too  much 
to  their  own  promotional  interests;  in  such  cases,  either  the  data 
and  their  interpretations  should  be  thoroughly  authenticated  or 
liberal  reservations  should  be  made  before  the  results  are  accepted 
The  Industrial  Arts  Index,  to  be  found  in  most^  important 
libraries,  contains  references  to  many  trade-magazine  articles 
and  should  be  consulted  in  any  search  for  material  of  this  kind. 

Other  sources  to  be  found  in  the  card  catalogues  of  almost  all 
well-equipped  libraries  are:  The  AgrieuUural  Index,  The  Cumulative 


COLLECTION  OF  DATA  97 

Book  Index,  Publishers'  Trade  List  Annuals,  various  trade  direc- 
tories, International  Index  to  Periodicals,  Engineering  Index, 
Catalogue  of  United  States  Government  and  State  Departments, 
Social  Science  Abstracts,  Public  Affairs  Information  Service  and, 
of  course,  the  encyclopedias. 

Data  from  Government  Sources.  Material  published  by  the 
government  is  available  at  little  or  no  cost.  It  hardly  seems 
necessary,  nor  is  it  possible,  to  go  into  detail  about  all  the  various 
types  of  information  obtainable  from  government  sources.  The 
most  recent  population  census  figures,  the  Census  of  Distribution 
and  the  Census  of  Manufactures  should  surely  be  examined  by 
anyone  undertaking  almost  any  type  of  market  study.  Obtain- 
able from  the  Department  of  Commerce  are  production,  distribu- 
tion and  consumption  figures  on  practically  all  industries  as  well 
as  import  and  export  data.  The  Marketing  and  Research  Divi- 
sion of  the  Bureau  of  Foreign  and  Domestic  Commerce  continu- 
ously publishes  material  relative  to  marketing  possibilities  of 
various  kinds  of  merchandise. 

This  bureau  also  publishes  commercial  surveys  of  various  sec- 
tions of  the  country  and  maintains,  as  well,  a  Business  Informa- 
tion Service  covering  a  wide  range  of  subjects., 

The  Market  Data  Handbook,  the  latest  issue  of  which  was 
published  in  1936,  gives,  in  a  condensed  form,  statistical  data  on 
distribution  of  populations  and  their  relation  to  production  and 
distribution.  On  certain  types  of  problems,  particularly  those 
dealing  with  the  marketing  of  farm  products,  a  great  deal  of  good 
material  can  be  gotten  through  the  federal  and  state  departments 
of  agriculture;  in  other  types  of  cases,  information  may  be  pro- 
cured in  the  U.  S.  Department  of  Labor,  through  its  Bureau  of 
Labor  Statistics,  from  such  agencies  as  the  Federal  Trade  Com- 
mission and  the  Federal  Reserve  Board  and  from  appropriate 
state,  county  and  municipal  departments  and  bureaus. 

In  any  marketing  study  reference  should  be  made  to  every 
available  list  of  such  material  and  in  the  larger  cities  a  visit  to  the 
local  office  of  the  Department  of  Commerce  will  be  found  highly 
profitable. 

Data  from  Media  or  Institution  Sources.  In  recent  years  the 
magazines  of  substantial  circulation  have  contributed  extensively 
to  the  general  fund  of  marketing  information.  All  this  is  avail- 
able to  the  student  of  any  individual  problem.     Generally  speak- 
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ing  two  types  of  material  may  be  obtained  from  such  magazines. 
There  are  data  relating,  first,  to  their  own  circulation  and  adver- 
tising promotion  work  and,  second,  to  general  marketing  or 
Sbution  problems-prepared  for  the  benefit  and  use  of  their 

"Xta*  category  there  are  examples  of  both  good  and  bad 
research  work.     Some  of  the  material  designed  for  the  magazines 
Tn  promotional  purposes  has  been  developed  in  strict  accord 
with  the  best  standards  of  research  practice  and,  for  such  matters 
as  the  sale  or  purchase  of  advertising  space,  may  be  relied  upon 
implicitly;  on  the  other  hand,  there  are,  unfortunately,  occasional 
examples  of  unreliable  studies,  improperly  or  unwisely  conducted 
and    sometimes,  even  willfully  misinterpreted.     Happily,  how- 
ever, instances  of  the  latter  sort  are  becoming  increasingly  rare^ 
These  media  promotion  studies,  of  the  sounder  type    are  ot 
importance  not  only  in  providing  points  of  departure  for  he  more 
particularized  analyses  of  individual  conditions  or  problem but 
frequently  in  supplying  such  comprehensive  information  a to 
obviate  extended  and  costly  independent  surveys  of  difficult 

mTn  the  second  category  of  material-general  marketing  data 
which  may  be  used  as  the  basis  for  most  distribution   sales  and 
advertising  analyses-the  data  provided  by  these  publications  is 
rf  the  utmost  vaL,     Few  companies,  for  instance,  could  deve  op 
for  their  own  use  such  material  as  is  contained  in  the  Tradtng 
Area  System  of  SaUs  Control,  prepared  by  the  In ernatoud 
Magazine  Company;  the  collection,  in  such  readily  usable  form, 
of  the  census  data  published  by  the  Curtis  F^Om 
and  their  Sales  Quotas  manual,  published  annually;  the  data  on 
Home  Ownership  of  Electrical  Power,  presented  from  time  to 
time  by  the  Crowell  Publishing  Company;  the  analysis  of  Home 
Telephone   Ownership,   published  by  Literary  Digest;  Hearsts 
BJs   of  Sales   Quota   Making;   True    Story's   Reader   Survey 
Liberty's    "Over-the-Counter"    Influence    on    Saks    by    Brands, 
Literary  Digest's  Lord  of  the  Telephone  Manor;  Markets  by  Income 
bv  Time  magazine;  and  other  examples  too  numerous  to  mention. 
Data  of  this  sort  may  prove  immensely  valuable  for  any  company 
planning  marketing  studies. 

Many  magazines  serving  particular  groups  have  developed 
specialized  information  relating  to  those  groups  and  their  inter- 
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ests.  This  is  particularly  true  of  farm  magazines  like  the  Capper 
and  Meredith  publications,  the  Webb  Publishing  Company  in 
Minneapolis  and  others;  also  of  Women's  Wear  and  other  such 
publications  with  a  more  or  less  special  or  localized  circulation. 
These  organizations  can  frequently  furnish  material  on  their 
particular  subjects  or  fields  which  might  otherwise  be  difficult  to 
obtain. 

For  single-market  studies  and  detailed  analyses  of  their  com- 
ponent sections,  many  of  the  local  newspapers  have  developed 
important  data  concerning  the  population,  income  groups,  loca- 
tion of  outlets,  distribution  and  consumption  by  brands  and  other 
marketing  factors  affecting  their  own  cities.  Controlling,  as 
newspapers  do,  the  approach  to  their  local  markets,  they  have 
the  best  possible  opportunity  and,  certainly,  the  incentive  to 
develop  material  necessary  to  advertisers  entering  those  markets. 
The  New  York  City  Market  Analysis,  compiled  jointly  by  The 
New  York  Times,  The  New  York  Herald  Tribune  and  The  News, 
is  an  excellent  example  of  this  sort  of  study;  Valuable  Data  of 
1932,  published  by  The  Sun  (N.  Y.),  is  another.  In  studying  any 
given  community,  therefore,  the  marketing  or  advertising 
departments  of  all  the  local  newspapers  should  be  consulted  early 
and  probably  often. 

In  the  same  connection  one  can  reach  a  combined  and  fruitful 
source  of  local  data  through  such  groups  of  publishers  as  the 
American  Newspaper  Publishers  Association  and  through  such 
publications  as  the  Editor  and  Publisher  and  the  Major  Market 
Newspapers.  Among  such  groups  as  these  there  is  available  at 
least  some  information  on  practically  all  the  more  prominent 
communities. 

For  information  regarding  advertising  expenditures,  reference 
may  be  made  to  National  Advertising  Records  or  to  Publishers 
Information  Service,  if  it  concerns  magazines,  farm  papers,  and 
radio;  and  to  Media  Records,  Inc.,  if  the  data  should  concern 
newspapers. 

These  institutions,  particularly,  Media  Records,  Inc.,  can  be 
used  with  excellent  results  in  finding  promising  markets.  It  is 
necessary  only  to  compare  the  records  of  the  various  markets  to 
find  those  in  which  the  local  merchants  and  the  dealers  in  the 
appropriate  line  are  actively  advertising.  Naturally,  a  market 
in  which  the  dealers  are  alert  and  aggressively  after  business  is  a 
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more  inviting  and  promising  market  than  one  in  which  the  dealers 
show  little  or  no  disposition  toward  advertising  or  sales  promo- 
tion     These  organizations,  therefore,  are  important  sources  of  _ 
information,  wherever  the  problem  is  to  find  new  markets. 

In  any  studies  of  radio,  both  the  National  Broadcasting  Com- 
pany and  the  Columbia  Broadcasting  Company  have  information 
Liable  on  all  angles  of  the  national  situation      Various  loca 
stations  have  made  studies  of  their  position  m  their  own  fields 
and,  in  the  process,  have  accumulated  considerable  material  of  a 
Ire  general  nature  in  relation  to  marketing  in  then-  respective 
communities.     These   are,   naturally,   ^f^^XZZZ 
connection  with  any  study  of  radio  advertising.     Many  other 
business  organizations,  advertising  firms  and  research  agencies 
have  contributed  enormously  to  the  analysis  of  radio  broadcasting 
and  advertising.     These  data,  however,  are  generally  closed  to 
"e  public;  although,  on  proper  approach  and  where  there  is  no 
conflict  of  interest,  much  of  it  can  be  obtained. 

Certain  larger  institutions  and  foundations  have,  through  then 
continual  study  of  various  aspects  of  business,  economics  govern 
meat,  social  conditions,  etc.,  collected  materia    of  the  utmo t 
value  to  the  student  in  marketing.     This  is  sometimes  obtainable 
in  published  form,  as,  for  example,  the  recent  publications  of  the 
Brookings    Institution-America's    CapacUy    to    Consume    and 
America's  Capacity  to  Produce.     Besides  these  there  are  publica- 
tions issued  by  such  organizations  as  the  National  Bureau  of 
Economic  Research,  the  National  Industrial  Conference  Board, 
the  Psychological  Corporation  and  the  Metropolitan  Life  Insur- 
ance Company;  the  monthly  issues  of  The  Index,  published  by  the 
New  York  Trust  Company  and  the  similar  digests  by  other  banks 
the  books  and  pamphlets  issned  by  the  Amerman  Management 
Association;  the  regular  editions  of  the  Harvard  Business  Renew 
issued  by  the  Harvard  School  of  Business  Administration    the 
reports  Lued  by  the  Textile  Foundation    such  as  ProducUon 
and  Distribution  of  Silk  and  Rayon  Broad  Goods;  and  innumerable 

others  of  this  type.  .  , 

On  special  business  subjects  reference  might  be  made  to  the 
Social  Science  Research  Counsel;  the  Carnegie,  Rockefeller  and 
Russell  Sage  foundations ;  the  reports  and  papers  published  by  such 

organizations  as  the  American  Statistical  Association  and  those 
others  of  like  character  devoted  to  psychology,  economics  and 
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sociology;  the  reports  of  the  President's  Committee  on  Recent 
Economic  Changes  and  of  his  Research  Committee  on  Social 
Trends,  the  large  banks,  life  insurance  companies  and  business 
institutions  of  all  kinds. 

Trade  associations  should,  naturally,  be  referred  to  for  data  in 
their  particular  fields.  Not  all  of  these  organizations  are  equally 
well  supplied  with  reliable  material,  but  in  practically  every  case 
they  can  give  at  least  some  important  information  and  sometimes, 
when  sufficiently  interested,  they  may  even  collect  the  data,  on 
request.  Associations  frequently  have  interesting  and  valuable 
records  of  the  early  development  of  their  industries,  even  of 
individual  member  firms,  which  would  be  unobtainable  in  any 
other  way.  The  Copper  and  Brass  Research  Association,  the 
American  Paint  and  Varnish  Association,  the  Cotton  Textile 
Institute,  the  Edison  Institute  and  the  National  Electric  Manu- 
facturers Association  are  good  illustrations  of  trade  associations 
which  may  yield  excellent  information  in  their  respective 
industries. 

Some  of  the  most  effective  research  work  emanates  from  asso- 
ciations in  related  trades  which  have  problems  in  common. 
These  related  associations  are  also  important  as  sources  for 
personal  contacts,  for  published  and  for  privately  collected 
material.  In  their  particular  fields  such  groups  as  the  Associa- 
tion of  National  Advertisers,  the  American  Association  of  Adver- 
tising Agencies,  the  Industrial  Advertisers  Association,  the 
National  Manufacturers  Association,  the  National  Association  of 
Broadcasters,  the  Advertising  Federation  of  America,  the  Ameri- 
can Federation  of  Labor  and  other  groups  associated  for  a  common 
purpose  have  unusual  opportunities  and  facilities  for  authorita- 
tive research.  They  should  be  referred  to  especially  in  the  initial 
stages  of  any  investigation  within  the  purview  of  their  special 
interests. 

Practically  all  the  large  universities  have  departments  of 
marketing.  These  departments  have,  in  some  instances,  entered 
the  field  of  commercial  research,  making  actual  studies  for  particu- 
lar firms  or  industries;  but  their  reports  are  not  always  publicly 
available.  Some  of  these  institutions,  however,  have  brought 
together,  through  the  years,  a  rich  accumulation  of  studies  and 
analyses  relating  to  many  and  varied  marketing  problems.  Such 
resources  are  of  the  utmost  importance  and  they  are  frequently 
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made  accessible  to  interested  persons.  The  Harvard  School  of 
Business  Administration  is  the  foremost  example  of  such  an 
fns  tutTon.  For  some  years  it  has  been  conducing  independent 
Stee  o  some  of  the  most  important  problems  of  business  and 
has  prepared  and  published  a  number  of  volumes  treatmg  of 

" iTmosfall  the  large  universities  and  many  colleges  have 
assembled  some  material  on  particular  problems  m  which  they 
TavTbeen  interested,  and  as  sources  these  are  well  worth  con- 
skTeration  in  any  marketing  study.  The  Nebraska  Market 
£5°  the  Michigan  Case  Studies  and  the  N«c  York  Umvemty 
Svecific  Surveys  are  competent  examples  of  such  sources 

In  the  larger  universities  these  departments  are,  m  the  mam 
headed  by  men  of  practical,  as  well  as  theoretical,  experience  and 
siTe  their  studies  are  most  often  directed  toward  a  genera 
analys  s  of  a  situation,  and  certainly  are  pursued  with  complete 
freedom   from   bias,  the  data  they   collect  may   general  y  be 
accepted  as  reliable.     These  departments  may  also  be  approached 
for  hiblioeraphies  in  their  special  fields  of  interest, 
"advertising  agencies  have  developed  for  then -own  use 
and  in  some  instances  for  the  use  of  others,  important  business 
mdices      The  Marketing  Area  Study,  published  annually  by  the 
J    Walter  Thompson  Company,  presents  this  material  m  an 
effilnt  and  highly  important  way.     Distorted  maps,  showing 
fnula  ion  and  other  indices  of  value  in  marketing,  as  published 
byPErw^  Wasey  and  Company,  make  such  factors  easy  to 
Suable      Other  advertising  agencies,  McCann  Encson    Inc 
instance   have  developed  general  and  specific  sales  potential 
indices   b^  trading  areas'or  by  counties,  which  may  also  have 
considerable  value  in  some  cases. 

Besides  all  these,  much  valuable  material  can  usually  be ^had 
from  chambers  of  commerce-including,  of  course,  the  Chamber 
of  Commerce  of  the  United  States-from  local  boards  of  trade, 
t^hone  companies  and  other  ^^£*«*S 
the  various  municipal  bureaus,  special  bodies  like  the  rort 
Authority  in  New  York  and,  for  some  purposes,  even  from 
religious  and  charity  organizations. 

The  Intermediate  Class 
Some"  studies  of  recorded  data  may  require  something  more 
thanTndSual  action,  but  still  far  less  than  an  organization;  or 
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they  may  involve  an  organization  so  limited  as  to  represent  simply 
an  extension  of  the  individual  investigator.  In  either  case,  this 
class  of  studies  is  clearly  differentiated  from  the  full  group  opera- 
tion. In  these  cases,  the  data,  while  recorded,  are  not  completely 
assembled,  as  in  the  foregoing  types,  nor  are  their  sources  so 
widely  separated  as  to  require  collection  through  an  organized 
effort. 

The  technique  involved  in  this  class  of  studies  advances  only 
slightly  beyond  that  required  for  individual  action  and  derives 
from  the  circumstance  that  related  or  corresponding  data  are 
being  now  sought  from  recorded  sources  which  are  somewhat 
dispersed. 

That  is  to  say  that,  while  the  sources  discussed  in  the  preceding 
section  of  this  chapter  could  readily  be  handled  by  an  individual, 
the  sources  now  to  be  examined  are  of  very  much  the  same  charac- 
ter, but  scattered,  and  for  that  reason  likely  to  require  the  coopera- 
tion of  several  persons.  The  work  of  these  several  persons,  acting 
together,  is  not  to  be  confused  with  the  group  action  to  be  defined 
later.  Here  each  of  the  several  persons  is  simply  an  extension 
of  the  first — each  doing  in  his  own  locality  the  same  work,  in  the 
same  manner,  at  the  same  time. 

The  following  represent  the  data  sources  of  this  type. 

Data  from  Key  Sources.  What  are  here  referred  to  as  "key 
sources"  would  be  just  such  organizations,  media  and  institu- 
tions as  might  be  referred  to  in  an  individual  study,  except  that 
for  the  larger  purpose  the  inquiries  would  be  directed  to  these 
sources  simultaneously  in  as  many  areas  as  are  necessary  to  effect 
the  object  of  the  study. 

For  example :  the  chamber  of  commerce  may  be  a  key  source  for 
individual  action  in  one  city,  immediately  within  reach  of  the 
research  director  himself.  If  it  were  desired,  however,  simultane- 
ously to  assemble  comparable  data  by  personal  solicitation  from 
chambers  of  commerce  in  a  number  of  cities,  one  person  would  be 
required  in  each  city  to  impersonate  the  research  director  and  to 
make  the  direct  search  he  himself  would  make  if  there  in  person. 

Data  from  Client  or  Company  Sources.  In  the  initial  stages 
of  a  survey  it  is  probable  that  the  history  of  the  client  will  have 
been  thoroughly  covered.  As  the  work  develops,  however,  the 
records  of  the  client  become  of  particular  importance.  They  not 
only  provide  specific  data  bearing  on  the  problem  but  frequently 
disclose  other  possible  and  promising  avenues  of  inquiry. 
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The  client's  records  are  usually  the  only  authentic  source  for 
studies  of  sales-by  territory,  by  salesman,  by  product,  by  profit 
yield  or  by  any  other  distinguishing  factor;  they  represent  the 
primary  source  of  data  for  forecasts  of  total  or  sectional  sales  or 
for  budgeting  and  controlling  marketing  costs,  or  for  calculating 
trends  over  periods  of  years;  they  also  provide  the  factual  basis 
for  all  sorts  of  executive  action-such  as  the  building  of  sales 
quotas;  planning  salesmen's  compensation;  organizing,  training 
and  managing  the  sales  staff;  governing  the  direction  and  pres- 
sure of  advertising  and  all  related  activities. 

The  records  of  a  business  represent  the  most  common  field 
for  any  direct  investigation.  This  type  of  study  has  been  referred 
to  in  Analyzing  the  Problem  and  again  in  Planning  the  Procedure. 
It  is  highly  essential,  therefore,  carefully  to  study  the  clients 
records,  not  only  because  the  answer  to  the  whole  problem  may 
lie  hidden  there  but  because  that  background  may  be  relied  upon 
to  indicate  what  additional  information  must  be  procured  from 

outside  sources.  .    '  .  ,     .    ul 

Data  from  Authorities  and  Specialists.  It  is  highly  desirable 
to  talk  freely  with  such  persons  as  are  known  to  have  special 
knowledge  of  the  problem  being  studied.  Where  there  is  an 
active  group  in  an  industry,  a  discussion  with  the  officers  of  its 
trade  association  may  prove  productive  and,  where  the  problem 
is  not  too  intimate  or  confidential,  significant  information  may 
be  gotten  from  competitive  organizations,  from  manufacturers, 
wholesalers  or  other  distributors  in  a  given  industry  Inproblems 
concerning  distribution  practices  and  methods,  the  competitive 
source  is  particularly  valuable.  „or+a;n 

In  practically  every  line  and  even  m  every  market  a  certain 
few  individuals  have  acquired  conspicuous  experience.  In  cer- 
tain types  of  studies  the  opinions  of  such  persons  may  with 
varying  degrees  of  safety,  be  accepted  as  data  of  qualitative 
character  or  as  corroboration  of  information  otherwise  obtained. 

By  Group  Action 
Under  this  heading  will  be  considered  those  more  scattered 
sources  from  which  recorded  data  may  be  collected  efficiently  only 
bv  organized  effort.  Naturally,  as  the  purpose  of  a  study  broad- 
ens and  the  field  of  inquiry  widens,  the  question  of  technique 
assumes  a  correspondingly  increasing  importance.  Some  sort 
of  organization  becomes  necessary.     It  need  not  be  so  complex 
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an  organization  as  is  required  for  the  collection  of  unrecorded 
data  but,  in  some  degree,  the  same  problems  of  structure  and 
management  present  themselves. 

Certainly,  some  more  formal  sort  of  questionnaire  will  be 
required  but  since,  elsewhere  and  especially  in  the  chapter  fol- 
lowing this,  the  technique  of  building  a  questionnaire  and  han- 
dling an  organization  is  adequately  covered,  it  seems  sufficient 
here  simply  to  suggest  some  of  the  sources  which  belong  in  this 
category. 

Data  from  Multiple  Unit  Sources.  These  are  sources  available 
in  substantial  numbers  and  more  or  less  homogeneous  in  charac- 
ter. The  wholesalers  in  a  given  industry  would  be  an  example. 
Their  respective  operating  and  accounting  systems  may  vary 
greatly  but  the  underlying  character  of  the  data  recorded  would 
be  fairly  uniform  and,  when  drawn  from  a  number  of  units,  would 
likely  prove  significant  for  all  of  them. 

In  a  field  for  group  action,  the  element  of  numbers  is,  of  course, 
important.  It  is  conceivable,  for  instance,  that  discussions  with 
two  or  three  wholesalers  on  the  subject  of  operating  costs  may 
serve  as  a  background  for  some  general  conclusions;  but,  if  the 
problem  were  to  devise  concrete  methods  of  reducing  operating 
costs  for  wholesalers  as  a  class,  it  would  be  necessary  to  extend 
such  discussions  over  a  wide  field  and  to  touch  a  considerable 
number  of  wholesalers. 

There  are  many  problems  whose  solutions  rest  upon  recorded 
data  obtainable  from  such  multiple  unit  sources.  A  manufac- 
turer may  need  recorded  data  from  the  files  of  his  distributors — as 
a  basis  for  some  extraordinary  sales  or  advertising  effort,  or  for 
the  development  of  quotas,  or  for  studies  of  sales  or  delivery 
costs.  Data  from  the  delivery  records  of  many  establishments 
may  be  used  in  determining  trading  areas  for  local  stores  and 
for  reducing  service  costs.  In  fact,  any  study  which  requires 
recorded  data  from  the  files  of  a  number  of  like  sources  is  within 
this  category. 

Multiple  unit  sources  were  employed  notably  in  the  Louisville 
Grocery  Survey  and  in  the  Saint  Louis  Drug  Store  Survey.  In 
those  researches,  through  the  study  of  records  in  the  many  stores 
in  which  analyses  and  tests  were  made,  it  was  possible  to  study 
old  data  and  develop  new  in  a  manner  and  with  results  never 
before  attained.  The  same  type  of  work  is  being  done  by  various 
organizations,  through  the  use  of  a  number  of  test  or  laboratory 
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stores  in  which  records  of  sales  of  given  products  and  the  effect 
of  specific  promotion  efforts  may  be  measured  over, a  penod  of 

"'Data  from  General  Field  Researches.  As  distinguished  from 
the  foregoing  type,  the  sources  in  this  category  may  be  called 
heterogeneous,  in  that  the  desired  information  is  not  confined  to 
any  group  of  like  persons  or  businesses.  It  represents  research 
of  the  many  factors  in  the  general  field  of  an  mdustry-drawn 
from  competitors,  authorities,  allied  groups  and  others  m  any 
field  who  have  knowledge  of  the  subject  being  studied. 

The  fact  that  the  quest,  here,  is  for  data  already  recorded  dif- 
ferentiates this  type  of  group  effort  from  that  employed  m  collect- 
ing unrecorded  or  undeveloped  data,  as  later  d.scussed. 

Data  from  Collaborative  Sources.  Some  marketing  problems 
are  of  such  general  nature  that  it  is  to  the  advantage  of  all  who 
are  interested  to  collaborate  in  obtaining  and  analyzing  the 
Lets.  Where,  for  example,  a  problem  affecting  one  industry 
overlaps  several  others,  the  data  obtainable  through  the  col- 
llborative  efforts  of  the'various  bodies  may  provide  the  soundest 
possible  base  for  the  study. 

Consider,  for  example,  a  problem  centering  m  the  field  at 
ehain-store'  distribution-the  question  of  quantity  discounts 
Clearly,  this  question  affects,  in  some  manner,  every  manu 
f acturl  in  any  industry  who  supplies  a  chain-store  group.  Any 
completely  disinterested  study  of  the  effect  of  quantity  discount^ 
Sore,  or  any  really  sincere  study  designed  to ,  arrive  at  an 
equitable  definitL  must  logically  be  based  upon  data  procured 
from  collaborative  sources. 

Wherever  it  is  possible  to  enlist  the  cooperation  of  all  groups 
having  allied  problems,  their  experiences  records,  costs  ate 
areas  etc.,  may  be  combined  to  the  benefit  of  all.  Data  from 
eollaboratiVe  sources  may  also  be  employed  in  the  development 
merchandising  projects  and,  cleared  through .such an  organiza- 
tion as  the  U.  S.  Chamber  of  Commerce,  as  a  basis  for  industrial 

advancement  generally.  thrnnirVj 

Statistical  Culling.     This  is  a  purposeful  browsing  through 
the  general  field  of  marketing,  economic  and  research  literature 
er  random  material  or  statistics  which  might  be  applicable  to 
a  specific  marketing  study  or  which  might  suggest  new  approaches 
or  new  points  of  view. 
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In  exploratory  studies,  this  is  a  particularly  useful  source  of 
material.  For  example:  A  research  agency,  seeking  the  reasons 
for  a  sudden  and  marked  decline  in  the  sales  of  a  client's  food 
commodities  in  a  southwestern  territory,  was  started  on  its  way 
toward  a  solution  by  data  unexpectedly  gleaned  from  the  educa- 
tional field. 

A  trade  magazine  had  published  some  tables  showing  the 
extent  to  which  the  colleges  in  its  state  were  accepting  home- 
canned  foods  in  payment  for  tuition.  Nowhere  in  the  field  work 
had  home  canning  appeared  as  a  factor.  It  would  not  normally 
suggest  itself  as  a  factor.  But  obviously,  its  effect  had  to  be 
investigated. 

This  new  inquiry  showed  that  practically  all  the  department 
stores,  as  well  as  the  smaller  merchants  throughout  the  area,  were 
also  accepting  home-canned  foods  in  barter.  The  practice  had 
grown  quietly  into  a  widespread  and  significant  system. 

Investigation  showed,  also,  that  the  season's  sales  of  glass  jars 
in  that  section  had  trebled  all  previous  records;  that  the  manufac- 
turers of  tin  cans  for  home  use  had  shipped  into  the  territory  a 
sufficient  quantity  to  produce  the  equivalent  of  more  than  a 
million  cases  of  similar  commercial  products;  while  manufacturers 
of  home-canning  machinery  had  supplied  that  area  with  enough 
equipment  to  produce  its  annual  requirements  several  times  over. 

Further  study  showed  this  situation  to  have  grown  naturally 
and  inevitably  from  the  fact  that  the  three  major  commodities 
upon  which  the  spendable  income  of  that  area  depended — cotton, 
cattle  and  oil — had  been  thoroughly  demoralized  as  to  price. 
Farmers  and  ranchers  who  formerly  had  not  even  maintained  a 
garden  to  supply  their  own  tables,  were  now  raising  excessive 
quantities  of  vegetables  to  satisfy  common  family  needs  by  barter. 

It  is  not  difficult  to  comprehend  the  bearing  of  such  facts  on 
the  interests  of  competitive  food  manufacturers  who  might  look  to 
that  area  for  some  part  of  the  volume;  and  in  this  case,  the  situa- 
tion came  to  light  as  a  result  of  " statistical  culling" — browsing 
through  the  available  current  literature  pertaining  to  that 
section  of  the  country. 
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CHAPTER  VI 

COLLECTION  OF  DATA 

PART  2.     UNDEVELOPED  OR  UNRECORDED  DATA 

(As  Presented  in  Chart  F) 

This  type  of  data  is  spread  more  or  less  broadly  through  the 
field  of  inquiry.  Its  assembly  for  study  requires  something 
more  than  a  mere  reference  to  records.  The  data  desired  are 
procured  from  a  multiplicity  of  original  sources  and  by  any  or  all 
of  the  four  basic  methods — direct  investigation,  mail,  telephone 
and  personal  interview.  When  procured,  data  of  this  type  are 
usually  in  what  might  be  called  a  raw  state.  They  have  to  be 
worked  over  and  brought  into  such  relationships  as  may  best 
meet  the  requirements  of  the  problem. 

Here,  too,-  in  connection  with  unrecorded  data,  a  distinction 
must  be  made  between  that  which  may  be  collected  by  individual 
effort  and  those  more  widely  scattered  forms  the  collection  of 
which  requires  an  organization  more  or  less  elaborate. 

By  Individual  Action 

As  pointed  out  in  the  discussion  of  recorded  data,  this  caption 
is  not  to  be  construed  solely  as  relating  to  the  number  of  persons 
engaged,  but  rather  as  indicating  a  type  of  unrecorded  material. 
This  type  of  data  is  not  to  be  found  already  assembled  or  recorded 
by  others  and  prepared  for  immediate  use  or  adaptation.  It 
has  to  be  dug  up  in  the  open  field,  as  it  were.  But  it  is  not  so 
scattered  as  to  be  beyond  the  capacity  of  an  individual  or  a 
rudimentary  staff  to  assemble.  At  any  rate,  it  entails  none  of 
the  technique  of  building  or  directing  an  organization. 

Information  falling  within  this  category  may  be  required  for 
such  purposes  as  to  augment  or  to  complete  data  previously  or 
otherwise  collected,  to  check  the  probable  accuracy  of  some 
recorded  data,  to  verify  an  assumption,  or  to  establish  an  entirely 
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new  factual  foundation  for  study.  The  most  appropriate  method 
of  collecting  the  data  in  any  case  depends  upon  the  requirements 
of  the  particular  problem. 

The  following  is  an  example  of  this  type  of  data:  A  certain 
concern  in  metropolitan  New  York  maintained  for  years  that  it 
could  not  sell  its  goods  in  Staten  Island.  The  records  of  several 
experimental  forays  into  that  region  seemed  to  bear  out  the 
contention.  In  the  course  of  a  study,  however,  a  marketing  man 
felt  it  necessary  to  check  this  situation.  Since  he  had  to  get 
the  opinions  and  experiences  of  retail  dealers,  the  data  he  required 
were  of  the  unrecorded  or  undeveloped  type,  but  they  were  not  so 
scattered  or  diffused  as  to  require  an  organization.  One  assist- 
ant, working  alone,  was  able  to  get  all  the  data  necessary;  and, 
incidentally,  the  established  conviction— as  so  often  happens 
with  impregnable  beliefs— was  shown  to  have  been  unfounded. 
It  was  later  proved  to  have  been  so  by  actual  sales  results. 

Studies  to  Develop  Qualitative  Data.  There  are  some  prob- 
lems whose  solution  lies  largely,  and  perhaps  even  wholly,  in 
qualitative  data.  Generally  speaking,  they  are  problems  which 
do  not  yield  to  purely  statistical  study.  The  solution  in  such 
cases  rests  on  a  reasoned  interpretation  of  facts,  opinions,  experi- 
ences and  observations  whose  significance  is  determined  more  by 
weight  of  authority  than  by  numerical  consideration.  This 
would  be  the  case,  for  instance,  if  the  problem  were  to  determine 
the  probable  reception  of  some  product  never  before  offered  for 
sale.  A  field  survey  by  group  effort,  considered  alone,  would 
be  of  no  avail.  The  dealers  and  the  general  public,  knowing 
nothing  about  the  product,  could  throw  little  dependable  lignt 
on  its  suitability  for  the  market. 

Suppose,  for  example,  it  was  desired  to  know  what  factors,  if 
any,  might  interfere  with  the  sale  of  chewing  gum  in  some  foreign 
country.  In  addition  to  all  the  data  which  might  be  procured 
in  a  field  survey,  it  would  be  necessary  to  ascertain  the  reactions 
of  certain  persons  or  institutions  whose  position  or  experience 
might  give  a  ponderable  value  to  their  views. 

To  illustrate:  Would  large  employers  of  female  help— the  per- 
sonnel directors  of  the  big  chain  and  department  stores,  for 
instance— countenance  the  use  of  chewing  gum  by  their 
employees?  Would  the  merchandise  managers  permit  the  sale 
of  chewing  gum  in  the  stores?     Would  there  be  any  associational 
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opposition  to  the  product?  Would  large  employers  of  male 
labor  object  to  chewing  gum?  How  would  the  superintendents 
of  great  foundries  and  plants  regard  chewing  gum?  What 
would  the  bankers,  teachers,  editors,  advertising  men,  publicists 
and  others  think  of  such  a  product  ?  It  might  even  be  necessary 
to  sound  out  the  attitude  of  the  government  as  well. 

Supplementing  such  inquiries,  the  project  might  be  subjected 
to  specially  devised  tests  which  would  also  come  within  this 
class  of  studies.  For  example:  The  traditional  users  of  chewing 
gum  in  the  United  States  are  young  people;  people  engaged  in 
sports,  either  as  participants  or  spectators;  and  people  who  do 
physical  work.  The  tests,  then,  would  consist  in  methods  of 
noting  the  reactions  of  persons  of  both  sexes  who  fall  within  these 
categories  of  traditional  users.  A  number  of  such  methods  are 
conceivable  and  the  resulting  data  would  represent  material  of 
the  unrecorded  type — assembled  by  individual  effort,  as  that 
term  is  here  denned. 

From  the  point  of  view  of  the  study,  the  data  resulting  from 
such  tests  would  have  a  more  definite  value  than  the  opinion 
previously  referred  to.  These  data  would  rest  upon  experience 
in  use.  Such  data,  combined  with  a  mass  of  enlightened  opinion 
and  the  results  of  a  field  study,  should  be  highly  significant  as 
to  the  prospect  of  chewing  gum  as  a  commercial  product  in  that 
country. 

As  a  further  example:  A  " consumer- jury"  test  of  advertising 
copy  might  fall  within  this  class  of  studies,  if  the  data  sought 
were  qualitative  in  character  and  if  the  study  were  conducted  on 
the  scale  of  an  individual  effort. 

There  is  a  very  wide  range  of  problems  involving  qualitative 
data — some  exclusively  and  some  only  in  part.  It  is  not  unusual, 
for  instance,  to  have  a  study  in  which  data  of  this  sort  are  being 
assembled  by  individual  effort  while  an  extensive  field  survey  is 
being  conducted  by  an  elaborate  group  action. 

The  technique  consists  uniformly  in  the  simple  process  of 
asking  questions,  by  any  one  of  the  four  general  methods,  in 
noting  the  replies  and  in  weighting  them  in  accordance  with  the 
relative  qualifications  of  the  respondents. 

Studies  to  Develop  Quantitative  Data.  This  type  of  data  has 
application  to  any  problem  whose  solution  rests  upon  the  fre- 
quency of  occurrence  found  among  the  factors  most  significant  to 
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the  issue,  where  those  factors  can  be  considered  numerically  and 
to  an  extent  that  admits  of  some  statistical  manipulation. 

The  term  " quantitative"  connotes  numbers— figures— measur- 
able amounts;  and  the  idea  of  " statistical  manipulation"  is 
suggested  as  an  element  in  the  definition  to  indicate  that  there 
must  be  quantities  sufficient  to  enable  one  to  arrive  mathemati- 
cally at  some  dependable  conclusions. 

When  researches  in  unrecorded  data  are  conducted  "by  indi- 
vidual action"  they  cannot,  of  course,  extend  over  any  very 
large  field,  except  when  done  by  mail  or  by  telephone.  If 
attempted  by  personal  interview,  on  any  large  scale,  such  a  study 
would  require  an  organization  and  it  would  then  belong  in  a 
different  category.  The  following  example  is  an  illustration  of 
the  individual  type  of  study: 

A  publishing  company  wanted  to  know  what  sort  of  people 
bought  a  certain  magazine  at  the  news  stands  in  one  of  the  larger 
cities.  An  even  hundred  stands  were  chosen  in  various  sections 
of  the  city  for  study.  The  number  was  set  arbitrarily,  with  the 
idea  that  it  could  be  increased  if  the  results  showed  too  great 
dispersion;  and  the  locations  of  the  stands  were  determined  by 
their  degree  of  prominence — from  the  most  centrally  situated 
and  busiest  downtown  stands  to  the  smallest  ones  around  the 
edges  of  the  town. 

Two  members  of  the  research  staff  were  detailed  to  cover  the 
stands  and  interview  every  person— man,  woman  or  child— who 
bought  a  copy  of  the  magazine  being  studied.  Only  three  or 
four  questions  were  asked  and  these  quickly,  because  people  do 
not  loiter  about  news  stands,  and  there  were  several  points  regard- 
ing each  respondent  on  which  the  observer  was  required  to  com- 
ment. As  a  result  of  this  work  about  twelve  hundred  interviews 
were  assembled — enough  to  permit  of  statistical  handling,  to 
prove  the  adequacy  of  the  sample  and  to  disclose  mathematically 
all  the  information  desired. 

The  " consumer-jury"  test  of  advertising  copy,  mentioned 
under  the  preceding  heading,  would  fall  within  this  class  of  studies 
if  it  were  constructed  to  result  preponderantly  in  quantitative 
material.  In  fact,  all  marketing  problems  whose  solution  entails 
a  study  of  figures  belong  in  this  class  if  the  data  can  be  acquired 
without  the  technique  of  an  organization. 

Exploratory  or  Experimental  Studies.  Not  all  marketing 
problems  can  be  brought  to  solution  solely  by  either  qualitative 
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or  quantitative  data — within  the  meaning  of  those  terms  as  used 
under  the  two  preceding  headings.  Problems  are  frequently 
encountered  which  present  no  suggestion  as  to  where  the  solu- 
tion may  lie.  Either  qualitative  or  quantitative  data  may  be 
required,  and  more  likely  both,  but  the  sources  must  be  found  by 
exploration  or  experiment.  An  assignment  expressed  in  such 
general  terms  as  "Find  out  what  is  wrong  with  the  marketing 
end  of  this  business"  would  be  an  instance.  Such  an  assignment 
suggests  nothing  except  that  the  researcher  must  begin  at  the 
very  top  or  bottom  of  the  business  and  work  clear  through  all 
its  ramifications  analytically,  before  he  can  have  any  sure  answer 
to  the  problem  as  presented. 

As  an  example  of  an  exploratory  study:  in  Chap.  II,  in  discuss- 
ing a  study  by  "direct  investigation"  the  problem  was  described 
of  a  manufacturer  whose  business  was  not  thriving  in  his  home 
market.  It  was  pointed  out,  there,  that  such  a  study  would 
reach  into  all  four  of  the  fields  which  comprise  the  marketing 
operation  of  all  businesses.  It  would  also  involve  both  qualita- 
tive and  quantitative  data  and  might  conceivably  utilize  all  the 
methods  of  collecting  data. 

A  similar  situation  would  be  presented  in  the  following  instance : 
a  baking  company,  formerly  quite  successful — operating  three 
plants  and  earning  several  hundred  thousands  of  dollars  a  year — 
fell  into  decline.  Both  its  volume  and  its  profits  were  slipping  at 
a  progressively  accelerating  pace.  The  president  of  the  corpora- 
tion could  not  understand  what  had  happened.  He  said  that 
they  were  making  just  as  good  a  product  as  ever  before  in  their 
career,  they  were  working  just  as  hard  and,  he  thought, 
just  as  intelligently;  he  said  that  they  were  trying  every 
conceivable  plan  to  stop  the  decline  but  that  nothing  seemed 
to  work. 

After  five  years  of  such  anxious  effort,  a  research  man  was 
commissioned  to  study  out  what  was  wrong.  Naturally,  he  had 
to  explore  every  phase  of  the  business;  and  he  had,  of  course,  to 
follow  the  orthodox  procedure,  studying  first  the  product,  then 
the  market,  then  the  firm's  policies  and  finally  the  firm's  selling, 
advertising  and  service — the  methods  and  means  it  employed  in 
marketing.  In  the  sense  that  there  could  be  no  predetermined 
specific  objective,  this  was  a  typical  exploratory  study  and  out 
of  it  grew  a  new  sales  approach  which  started  the  company  on 
its  way  back  to  substantial  dividends. 
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Another  example:  One  of  the  larger  food  manufacturing  cor- 
porations found  that  its  volume  in  a  certain  large  area  had 
declined  so  far  as  to  bring  its  sales  cost  in  that  territory  from 
7.5  per  cent  up  to  the  unheard-of  figure  of  30  per  cent.  Obvi- 
ously, something  had  to  be  done  about  it;  but  the  sales  depart- 
ment,' believing  the  situation  to  be  temporary,  was  afraid  of  any 
very  drastic  action.     A  study  was  made. 

The  purpose  of  the  study  was  to  find  the  factors  which  were 
inflating  costs;  to  determine  which  factors  could  be  corrected 
by  some  action  of  the  corporation  itself  and  which  were  beyond 
its  control;  and  to  determine  in  what  manner  the  corporation 
should  act  to  adapt  itself  to  the  situation. 

This  study  had  also  to  consider  the  problem  from  the  point  of 
view  of  the  products— as  to  whether  or  not  they  still  met  the 
requirements  of  the  people  of  that  area,  under  the  changed  eco- 
nomic conditions;  the  market— as  to  the  ability  and  the  disposition 
of  the  people  to  buy  such  products  as  the  corporation  offered; 
the  firm's  policies— sls  to  whether  any  change  in  this  respect  bore 
adversely  upon  its  sales  or  its  cost  of  selling,  and,  finally,  as  to 
whether  the  methods  and  means  being  pursued  by  the  corporation 
were  the  best  suited  to  the  situation  as  it  then  existed. 

This,  therefore,  was  a  typical  exploratory  study;  it  had  to 
search  everywhere  for  the  difficulty;  and  it  happened  that  in  all 
four  directions  data  were  found  which  either  affected  or  were 
affected  by  the  conditions  that  surrounded  this  manufacturer's 
marketing  opportunity  in  that  section  of  the  country  at  that 

time. 

The  study  showed  the  situation  to  be  due  fundamentally  to 
changed  economic  conditions.  The  company  could  not  control 
those  conditions;  its  fault  was  in  not  having  recognized  them 
earlier  and  in  not  having  adjusted  its  sales  setup  accordingly. 
As  a  result  of  the  study,  the  company's  own  sales  offices  were 
closed,  the  territory  was  combined  with  others  surrounding  it 
and  a  complete  change  was  made  in  the  method  of  contacting 
the  urban  trade  which  still  held  some  promise  of  business.  The 
company  got  as  much  volume  out  of  the  territory  as  it  had  been 
getting— and  the  cost  was  reduced  to  about  12  per  cent. 

Sometimes  an  exploratory  study  involves  not  only  marketing 
research  but  also  legal,  accounting,  economic,  psychological 
research— depending  upon  the  character  and  the  scale  of  the 
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enterprise.  Certainly,  for  these  special  phases  of  such  a  general 
study  specialists  should  be  procured.  The  research  director 
himself  must,  however,  understand  the  relationship  of  these 
various  phases  to  the  whole  situation  and  the  contribution  each 
might  make  to  the  solution  of  the  problem.  He  could  not  other- 
wise recognize  their  bearing  and  need. 

Experimental  data  differ  from  exploratory  in  that  they  are 
essentially  creative;  that  is  to  say,  in  an  exploratory  study  an 
examination  is  made  of  facts,  conditions,  circumstances  and, 
perhaps,  personalities  which  are  actually  existent  and  in  some 
measure  affecting  the  situation  for  good  or  ill. 

In  an  experimental  study  an  effort  is  made  to  determine  the 
probable  effect  of  some  factor  which  does  not  yet  exist  except 
perhaps  in  laboratory  form.  For  example :  a  large  manufacturer 
desired  to  ascertain  what  effect  a  certain  proposed  display  feature 
would  likely  have  on  his  volume  and  on  his  sales  costs;  whether 
the  rather  expensive  fixtures  should  be  given  away,  sold  or  loaned; 
what  additional  demands  might  be  made  upon  his  organiza- 
tion in  servicing  the  proposed  feature  and  several  other  similar 
questions. 

The  manufacturer's  sales  promotion  department  embarked 
on  an  "experimental"  study.  In  a  single  market,  fifty  installa- 
tions of  the  proposed  display  feature  were  made  in  stores  selected 
to  represent  the  various  classes  of  outlets;  for  a  full  year  the 
sales  and  all  incidental  experiences  relating  to  these  stores  were 
tabulated  and  correlated  with  predetermined  standards  of  expec- 
tation. Then  five  hundred  installations  were  made  in  a  metro- 
politan market  and  kept  under  controlled  conditions  for  a  period 
of  six  months.  It  was  only  after  all  phases  of  the  problem  had 
been  solved  by  the  experimental  research,  and  the  probable 
success  of  the  plan  determined,  that  a  complete  nation-wide 
campaign  was  undertaken. 

The  experimental  retail  stores,  mentioned  on  page  31,  are 
examples  of  this  type  of  study.  The  purpose  of  these  stores  is 
to  study  continuously  and  under  controlled  conditions  exactly 
what  happens  in  practice  with  respect  to  various  products  and 
merchandising  ideas,  their  effect  upon  the  customer  at  the  point 
of  sale  and  other  such  operating  problems. 


CHAPTER  VII 
GROUP  ACTION  AND  ORGANIZATION 

(Elaboration  of  Chart  F,  page  108,  Continued) 

The  next  several  chapters  will  treat  of  that  type  of  undeveloped 
or  unrecorded  data  which  are  still  more  widely  diffused.  These 
data  may  be  said  to  permeate  the  field  of  inquiry— awaiting 
concentration  for  some  specific  marketing  purpose.  Because 
the  collection  of  this  type  of  matter  involves  so  many  complex- 
ities, separate  chapters  will  be  devoted  to  the  several  major 
aspects  of  the  subject. 

Projects  in  this  broad  field  of  undeveloped  data  may  be  as 
general  as  the  Census  of  Distribution  or  as  specific  as  a  single- 
market  study  of  the  standing  of  a  product  or  brand.  This  is 
the  most  common  category  of  external  surveys— so  common,  in 
fact,  that  in  some  quarters  it  is  apparently  believed  to  encompass 
the  whole  range  of  marketing  research. 

In  this  class  of  studies  are  included  all  those  surveys  in  the 
field  of  unrecorded  data  which  entail  a  multiplicity  of  separate 
inquiries  conducted  in  accordance  with  a  uniform  pattern.  It 
embraces  the  hundreds  of  surveys  daily  crisscrossing  the  country 
by  mail,  the  scores  of  others  nightly  ringing  telephones  in  thou- 
sands of  homes,  and,  of  course,  the  innumerable  person-to-per- 
son solicitations  for  data  going  on  ceaselessly  and  practically 
everywhere. 

By  Group  Action 
The  distinguishing  feature  of  studies  in  this  category  is  that 
they  require  a  more  or  less  elaborately  developed  staff.  In 
extent  this  staff  differs  notably  from  that  "group  action"  which 
is  required  in  the  collection  of  recorded  data.  Both  as  to  function 
and  personnel  it  is  on  a  larger  scale.  A  glance  at  the  chart  on 
Planning  the  Procedure  will  suggest  again  the  steps  which  must 
be  taken.  The  forms  decided  upon  during  that  stage  have  now 
to  be  prepared;  then,  a  staff  consisting  of  reporters,  supervisors, 
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inspectors,  editors  and  tabulators,  has  to  be  selected  and  trained; 
a  routine  must  be  set  up  to  carry  the  work  along  efficiently  and 
economically;  controls  must  be  devised  to  protect  the  integrity 
of  the  work;  and  the  whole  project  must  be  integrated  as  to  both 
action  and  time. 

This  is  the  type  of  study,  too,  which  is  pursued  almost  exclu- 
sively by  mail,  by  telephone,  or  multiple  personal  interviews. 
The  very  nature  of  the  data,  diffused  as  they  are,  usually  pre- 
cludes direct  investigation  as  defined  in  this  treatise. 

Organization.  Structurally  there  are  many  variations  in 
research  organizations.  Some  are  local,  some  national  or  even 
international;  some  are  large  and  complex,  some  small  and  sim- 
ple; some  organizations  are  permanent,  others  are  thrown  together 
for  the  job  of  the  moment;  some  specialize  in  a  single  type  of 
industry,  others  spread  their  interests  over  many  fields.  But 
whatever  the  structure  may  be,  an  organization  must  have,  or  be 
given,  sufficient  flexibility  to  adapt  itself  to  such  specific  problems 
as  fall  within  its  scope. 

In  the  simpler  forms  and  in  organizations  built  for  single  opera- 
tions, flexibility  involves  no  great  difficulty.  Those  organizations 
are  "custom-made,"  so  to  speak,  to  fit  the  immediate  case.  But 
where  the  organization  is  large,  permanent  and,  perhaps,  national 
in  scope,  it  may  be  called  upon  for  simultaneous  studies  in  widely 
scattered  areas  on  radically  different  subjects  and  for  purposes 
or  objectives  just  as  diverse.  In  such  cases,  management  is  a 
major  executive  function;  it  is  an  indispensable  element  in 
a  research  organization  as  in  any  other  substantial  business 
enterprise. 

This  discussion,  however,  is  concerned  not  so  much  with 
organic  structure  as  with  the  integration  of  the  processes  and 
implements  likely  to  be  used  in  a  typical  research  operation  in 
the  field  of  unrecorded  data.  As  nearly  as  possible,  it  is  desired 
to  witness  the  accomplishment  of  each  step  in  such  an  operation. 

preparation  of  forms.  For  the  type  of  research  now  under 
consideration,  involving  the  collection  of  unrecorded  data  by 
group  action,  the  questionnaire  is,  of  course,  the  basic  implement. 
Work  sheets,  tabulation  and  other  forms  required  for  research 
of  this  type  may,  in  practice,  be  devised  at  this  point ;  but,  since 
these  forms  are  used  exclusively  in  the  organization  of  data,  they 
will  be  reserved  for  treatment  in  later  chapters. 
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In  preparing  any  kind  of  questionnaire,  whether  to  be  used  by 
mail  or  telephone  or  personal  inquiry,  we  have  to  refer  again  to 
the  stage  of  planning.  At  that  time  we  gave  some  thought  to 
"the  purpose  of  the  study."  Since  this  is  a  fundamental,  we 
begin,  now,  by  listing  just  what  questions  seem  in  our  judgment 
most  likely  to  bring  out  the  information  we  need  to  solve  the 
problem.  In  the  very  first  stage,  in  analyzing  our  problem,  we 
decided  what  we  had  to  find  out;  a  little  cogitation  now,  pred- 
icated, of  course,  on  some  experience,  should  suggest  what 
general  questions  might  prove  effective.  At  this  point,  it  makes 
no  difference  how  many  questions  there  are  or  how  they  are 
phrased;  we  simply  want  to  get  our  thoughts  down  in  black  and 
white  as  .a  foundation  on  which  to  build. 

With  the  list  completed,  we  begin  to  qualify  the  questions  to 
accord  with  several  governing  circumstances,  such  as: 

1.  How  are  we  going  to  ask  these  questions— by  mail,  by 
telephone,  or  in  person?  In  all  probability,  that  point  has  long 
since  been  decided  and,  as  this  discussion  proceeds,  the  adjust- 
ments will  be  indicated  which  must  be  made  in  the  questionnaire 
to  conform  with  the  basic  method  to  be  employed. 

2.  To  what  kind  of  people  are  we  to  address  these  questions? 
Are  they  men  or  women,  young  or  old,  native  or  foreign,  white  or 
colored?  Are  they  housewives,  "socialites,"  business  people, 
professional  people,  married  or  single?  Are  they  home  owners? 
Are  they  rich  or  poor?  Are  they  cultured  or  vulgar,  enlightened 
or  benighted?  Whatever  they  are,  their  characteristics  will  have 
to  be  considered  in  making  up  the  questionnaire.  And  this  is 
true  regardless  of  the  method  employed  in  presenting  it. 

3.  The  opportunity  for  questioning:  Will  the  interview  be 
held  in  an  office,  where  a  competent  executive  can  give  it  his 
time  and  attention,  or  in  a  shop  where  the  butcher,  the  baker 
or  the  candlestick  maker  is  too  busy  to  talk?  Will  it  be  held 
quietly  in  the  reception  room  of  a  home,  or  out  on  the  steps 
between  sweeps  of  a  portentous  broom?  Will  it  be  held  on  the 
street,  under  conditions  which  permit  the  respondent  to  answer 
freely  and  fully,  or  must  the  interviewer  run  down  the  steps  of  a 
subway  at  the  respondent's  heels  to  catch  his  answers  on  the  fly? 

4.  Who  is  to  ask  the  questions?  Is  the  field  staff  experienced, 
or  is  it  newly  recruited?  Are  the  workers  qualified  to  make 
significant  and  reliable  observations?     Will  they  be  able  to  com- 
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prehend  the  kind  of  questions  likely  to  be  used?  Are  they 
equipped  intellectually  to  elucidate  such  questions  as  might  be 
obscure  or  subtle? 

It  should  be  easy  to  perceive  how  each  of  these  considerations 
might  affect  the  questionnaire  as  originally  set  down.  These  are 
all  common-sense  factors,  to  be  determined  by  the  perspicacity 
and  judgment  of  the  research  director  in  each  case.  The  ques- 
tions as  they  are  presented  here,  in  these  paragraphs,  almost 
suggest  their  own  solution. 

In  addition  to  these  considerations,  however,  we  must,  in  the 
preparation  of  a  questionnaire,  give  attention  also  to  the  psy- 
chological ideas  reviewed  in  Chaps.  Ill  and  IV.  We  must  make 
the  questions  fit  the  respondent's  own  experience;  if  it  is  appro- 
priate, we  must  include  "last-purchase"  questions;  we  must 
avoid  questions  that  are  too  general,  or  embarrassing,  leading, 
misleading,  ambiguous,  confusing;  we  must  prepare  for  com- 
parative tables;  we  must  approach  the  topic  from  various  angles; 
we  must,  in  fact,  weigh  the  significance  of  all  the  suggestions  and 
ideas  elaborated  in  the  chapters  referred  to  on  psychological 
considerations. 

With  these  factors  in  mind,  we  have  finally  to  consider  in  detail 
whichever  of  the  three  methods  of  handling  the  questionnaire  we 
have  decided  to  use. 

To  determine  whether  or  not  the  situation  requires  or  permits 
a  mailed  questionnaire  a  number  of  considerations  must  be 
reviewed.  It  is  fundamental,  of  course,  that  the  questionnaire 
be  not  too  long  and  that  the  questions  be  expressed  in  clear, 
concise  and  unambiguous  terms.  Besides  these  points,  Miss 
Elsie  M.  Rushmore1  has  compiled  a  list  of  twenty-four  questions 
which  should  be  applied  to  any  situation  in  which  a  mailed 
questionnaire  may  be  contemplated.  These  are  the  questions — 
reprinted  by  permission: 

1.  Is  the  mail  questionnaire  a  sensible  technique  to  apply  toward  a 
solution  of  the  problem  in  hand? 

2.  Was  the  problem  clearly  formulated  before  the  questionnaire  was 
written? 

3.  Were  the  actual  questions  written  by  someone  who  has  the  gift  of 
asking  explicit  questions? 

1  Rushmore,  Elsie  M.,  "How  to  Get  Results  in  Mail  Questionnaires," 
Printers'  Ink,  Mar.  22,  1934. 
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4.  Is  the  list  to  which  the  questionnaire  is  to  be  sent  a  representative 
sample  of  the  potential  market  for  the  product? 

5.  Is  the  list  (figuring  on  a  25  per  cent  return)  a  sufficient  sample? 

6.  Is  the  letter  which  accompanies  the  questionnaire  simple,  brief  and 
courteous,  and  written  in  language  suited  to  the  type  of  person 
addressed? 

7.  Does  it  indicate  the  reason  why  the  respondent  has  been  asked  to  fill 
out  the  questions? 

8.  Is  every  question  clear  cut  and  explicit? 

9.  Is  every  question  asked,  in  such  a  way  as  to  be  likely  to  bring  an 
accurate  answer?  (Here  pictures  to  check  are  sometimes  a  great 
help.) 

10.  Is  sufficient  space  allowed  for  the  answers? 

11.  Is  the  arrangement  logical? 

12.  Are  the  questions  formulated  from  the  viewpoint  of  the  individual 
questioned? 

13.  Is  the  questionnaire  an  interesting  one  to  answer?  (The  percentage 
of  returns  depends  largely  upon  this.) 

14.  Does  it  look  easy  to  fill  out? 

15.  Is  it  of  reasonable  length?  (This  usually  means  about  eight  to  ten 
questions.) 

16.  Are  the  questions  asked  in  such  a  way  as  to  require  the  least  time  and 
effort  on  the  part  of  the  person  who  is  asked  to  answer  them? 

17.  Is  only  one  idea  included  in  each  question? 

18.  Has  every  question  a  direct  bearing  on  the  problem? 

19.  Are  the  questions  limited  to  the  number  necessary  to  secure  the 
desired  information? 

20.  Are  the  questions  framed  in  such  a  way  that  the  information  when 
secured  will  be  of  value  to  the  people  using  the  result? 

21.  Are  the  questions  framed  in  such  a  way  that  the  answers  lend  them- 
selves to  tabulation? 

22.  Are  the  questions  framed  in  such  a  way  that  as  many  data  as  possible 
may  be  secured  from  the  answers? 

23.  Is  there  plenty  of  space  for  comment  by  the  respondent? 

24.  Does  the  questionnaire  deal  primarily  with  factual  personal  data? 

If  the  answer,  then,  to  each  of  the  above  questions  is  "yes"  when 
applied  to  a  given  questionnaire,  the  next  step  in  standard  practice  is  to 
secure  a  trial  sample.  This  can  be  done  within  a  week  or  ten  days, 
including  tabulation,  by  selecting  local  addresses  from  the  proposed  list 
and  asking  the  respondents  for  a  reply  within  three  days  or  before  a 
given  date.  In  nine  cases  out  of  ten  this  sampling  will  result  in  some 
modification  of  the  original  questionnaire. 

Formerly  advertisers  thought  of  the  maili  questionnaire  chiefly  as  a 
cheaper  way  of  securing  information  from  the  consumer  than  by  means 
of  personal  interviews  and  the  decision  between  the  two  methods  was 
usually  made  accordingly.     As  a  result  of  actual  experience,  however, 
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QUESTIONS 


ABOUT     YOU,    THE    READER 


1.  Are  you  a  man? , Or  a  woman? 

Married? If  married,  how  long? years 

2.  Who  else  reads  your  copies  of  The  American  Home? 

Husband? Wife? : . . . 

Sons? How  many? 

Daughters? How  many? 

Others  in  family? How  many?. . . . 

Friends? . How  many?. . . . 

3.  Will  you  tell  us  of  some  definite  actions  you  have  taken  or  purchases 
you  have  made  as  a  result  of  reading  The  American  Home? 


QUESTIONS 


.    ABOUT    YOUR    FAMILY 


NONE     A     A  *    *A& 
a  6   tS» 


4.  How  many  adults  in  your  household? 

What  are  their  approximate  ages?. 


How  many  children? Their  Ages? 

How  many  in  school:  Public. .    .Private College. . . 


5.  How  many  servants  do  you  employ? 

Do  they  live  in  your  home? 

Do  you  employ  any  part-time  help? 


YesD  No  D 
YesD  No  D 


QUESTIONS 


.  .  ABOUT  THE  BITEADWINNER  OF  YOUR  householo 


*the  person  ip  your  family  who  is  the  chief  s 

6.  What  is  his  (or  her)  occupation? 


#- 


7.  Will  he  (or  she)  have  to  pay  an  income  tax  this  year? 

Yes  Q  No  t] 

8.  Does  he  (or  she)  have:                                               Yes  No 

A  savings  account?                       □  □ 

A  checking  account?                     □  Q 

Other  investments?                       □  Q 

9.  What  is  the  purpose  of  the  savings  account? 


1 0.  Does  he  (or  she)  carry  life  insurance  and  (do  you  mind  telling  us?) 
about  how  much?  $ 


1 1.  Does  he  (or  she)  carry  automobile  insurance? 


Yes 


No 
□ 


Fig.  4. — A  mail  questionnaire  made  interesting  by  illustrations. 
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QUESTIONS 


.    ABOUT   YOUR    HOME 


1 2.  Do  you  live  in  a  house?     □ 

1 3.  How  many  rooms? 

1 4.  Own  your  own  home? 
Own  any  other  houses? 

1 5.  Value  of  home?  $ .    . . 


Or  an  apartment?     Q 

. . .  How  many  bath  rooms? 

How  many  guest  rooms? 

Yes  D     No  D 
Yes  D     No  D 


How    old? . 


16.  If  you  pay  rent,  what  rent  do  you  pay?  $ 

1 7.  Is  your  home  in  the  heart  of  town?  Yes  D     No  D 
In  a  suburb  or  on  the  outskirts  of  the  city?  Yes  D     No  D 

In  the  country?       Yes  Q     No  □ 


1 8.  How  do  you  heat  your  house? 

Oil  Burner?  □  When  installed?. 

Gas  Burner?  □  When  installed?. 

Coal  Stoker?  D  When  installed?. 

Hand-Fired  Furnace?  □  When  installed? . 


1 9.  When  did  you  last  paint  your  house? 

:«  Outside? Inside?. 


20.  Do  you  plan  to  build  or  buy  a  home?  Yes  D    NoQ 

How  soon? 

How  many  rooms? % 

How  many  baths? > 

What  do  you  expect  to  spend?  $ 


21.  Do  you  plan  to  do  any  remodeling  or  modernizing  of  your  home? 

Yes  □     No  D 


How  soon? What  do  you  expect  to  spend?  $. 

What  do  you  expect  to  do? 


22.  When  you  build  or  remodel,  do  you  plan  to  put  in  air-conditioning? 

Yes  □     No  □ 


Fig.  4. — {Continued) 
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QUESTIONS 


about  THINGS  YOU  OWN 


23.  An  automobile?    One?     □         or  two?    □  or  three?  □ 

What  make? What  year? 

About  how  many  miles  did  your  car  (or  cars)  travel 

last  year? 

About  how  often  do  you  get  a  new  car? 

24.  What  brand  of  gasoline  are  you  using  in  your  car? 

Oil? Tires? Anti-Freeze? 


25.  Do  you  own  a  radio? 
28.  A  refrigerator? 

27.  A  washing  machine? 

28.  A  vacuum  cleaner? 


Yea  □     No  □    How  old? years 

Electric?  a         Gas?  □         Ice?  Q 
How  old?. . .  .years 

Yes  □     No  D    How  old? years 

Yes  □    No  D    How  old? years 


29.  An  electric  ironing  machine? 

Yes  □     No  D    How  old? years 

30.  A  kitchen  range?       Electric?   □     Gas?  Q    Oil?  □    Coal?  Q 

How  old?. . .  .years 


31.  A  sewing  machine? 


Yes  □    No  D    How  old? years 


QUESTIONS 


about  HOW  YOU  LIVE 


32.  Do  you  have  a  department  store  charge  account?  Yes  □     No  □ 

33.  Do  you  have  a  garden?        Yes  □     No  □ 

Like  to  work  in  it?     Yes  D.   No  D 

Employ  a  gardener?    Yes  □     No  □ 

About  how  much  do  you  spend  a  year  on  shrubs,  trees, 

lawn,  flower  and  vegetable  gardens?  $ 

34.  About  how  much  do  you  spend  for  food  a  week?  $ 

35.  Do  you  personally  shop  for  groceries? 

3B.  Where  do  you  do  most  of  your  entertaining? 

At  home?  □       At  clubs?  O     In  hotels?  □ 

37.  About  how  many  people  do  you  entertain  (formally  and  informally) 
in  an  average  month? : 


Fig.  4. — (Continued) 
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38.  Do  you  usually  take  a  vacation  every  year?  Yes  □     No  □ 

How  long  do  you  usually  stay  away? weeks 

How  far  do  you  usually  go? .  .  > miles 

Have  you  a  summer  place  of  any  kind?  Yes  □     No  □ 
Do  you  send  your  children  to  camp?      Yes  □     No  D 

39.  What  do  you  usually  spend  your  surplus  income  for — that  is, 
money  you  have  over  and  above  your  regular  expenses  which  you 
do  not  put  into  oavings? 

Home  improvements? 

Home  Furnishings? 

Entertaining? 

Hobbies?. 

Travel? 

Extra  clothes? .- 


YOUR  CHOICE 


OF  THESE  USEFUL  BOOKLETS  free 


I.  Flower  Arrangements  □ 

a.  The  Handy  Man's  Booklet  □ 

3.  How  to  make  your  own  Slip  Covers 

and  Draperies  D 

4.  Making  Lily  Pools  and  Rock  Gardens  Q 


In  return  for  your  helpfulness  in  answering  these  questions,  we 
shall  be  glad  to  send  you  free  any  one  of  the' booklets  listed  above. 
Just  indicate  with  a  check  mark  which  one  you  desire'  and  sign  your 
name  and  address  in  the  space  provided  at  the  bottom  of  the  page. 

Unless  you  want  one  of  the  booklets,  it  is  not  necessary  to  sign 
your  name.  Just  fold  Up  the  questionnaire  and  mail  it  in  the  stamped 
return  envelope  w.e  have  provided. 


Name 

Address ~ - * 

City.. >...,.- State, 

Fig.  4. — (Continued) 
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circumstances  proved  that  this  was  not  invariably  the  case  and  this 
fact  led  to  a  more  reasoned  consideration  of  the  appropriate  use  of  each 
method.  On  the  whole,  standard  practice  in  the  commercial  field  now 
tends  to  use  the  personal  interview  for  subjective  data — the  consumer's 
attitude  toward  the  product  or  process,  his  or  her  approach  to  the  sub- 
ject under  consideration,  preferences,  or  criticisms,  reservations  and  the 
reasons  for  these,  etc.  Such  data  are  more  successfully  elicited  during 
the  course  of  a  friendly  interview  by  a  trained  investigator  than  by  a  series 
of  written  questions.  Moreover,  such  data  must  be  evaluated  as  well 
as  collected.  The  mail  questionnaire,  on  the  other  hand,  is  generally 
found  to  be  preferable  for  quantitative,  factual  data  in  cases  where  the 
problem  is  clear  and  when  a  series  of  questions  must  be  asked  each  of 
which  requires  thinking  over  before  it  can  be  properly  answered. 

A  novel  questionnaire  is  presented  in  Fig.  4.  One  of  these 
questionnaires  was  placed  in  each  copy  of  one  of  the  issues  of  the 
magazine  and  each  reader  was  requested  to  fill  out  and  return  it.' 
Illustrated  as  it  is,  it  attracted  instant  attention  and  its  serio- 
comic style  led  to  a  comparatively  high  percentage  of  returns. 

In  preparing  this  schedule,  every  question  which  was  thought 
significant  to  the  purpose  of  the  study  was  set  up  first  in  words. 
Then  an  artist  caricatured  fifty  or  sixty  of  these  ideas  and  the 
questionnaire  was  then  tested  out  with  a  small,  selected  sample 
of  typical  respondents.  As  a  result  of  several  such  trials  the 
form  finally  emerged  as  shown. 

In  preparing  a  questionnaire  for  use  by  telephone  the  first 
factor  to  consider  is  time.  The  conversation  must  necessarily 
be  short,  so  the  questionnaire  must  also  be  short — the  questions 
being  few  in  number,  simple  in  structure,  easy  to  understand 
and  answerable  either  by  "Yes"  or  "No,"  or  by  other  equally 
concrete  response. 

It  must  be  remember.ed,  too,  that  the  same  psychological 
considerations  are  involved  here  as  in  mail  questionnaires  and 
those  presented  in  person.  The  questions  must  be  explicit  and 
objective,  neither  leading  nor  misleading;  and  they  must  take 
account  of  the  possible  factors  of  respectability,  vanity,  integ- 
rity— respectability  that  might  prompt  the  respondent  to  say 
she  has  a  radio  when  she  has  not,  vanity  that  might  permit  her 
to  recall  only  the  classical  programs,  integrity  (or,  rather,  its 
lack)  which  might  tempt  the  respondent  deliberately  to  distort 
her  data. 
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The  weakness  of  telephone  interviewing  is  that  there  can  be 
no  visual  check  on  the  respondent;  no  opportunity  for  observa- 
tion; no  material  for  comment  as  an  aid  to  interpretation;  no 
way  to  forestall  or  overcome  the  possible  nuisance  reaction  of  the 
respondent;  and  no  means  by  which  the  interviewer  can  correct 
the  answers  and  discard  the  palpably  incorrect  or  false. 

Several  years  ago  the  Arnold  Research  Service1  prepared  a 
comparative  tabulation  of  the  circumstances  under  which  tele- 
phone interviews  can  and  cannot  be  used  to  advantage.  These 
tabulations  are  shown  below  and  are  followed  by  several  samples 
of  telephone  questionnaires  (Figs.  5  to  8  inclusive). 

Telephone  Interviews  Can  Be  Used  to  Advantage 

1.  Where  the  information  to  be  obtained  is  fairly  limited. 

2.  Where  the  cost  is  an  important  factor. 

3.  Where  widespread  and  unclassified  interviews  are  desirable. 

4.  Where  classification  by  type  of  neighborhood  alone  is  necessary. 

5.  In  reaching  selected  names,  such  as : 

Individual  magazine  subscribers. 

Known  purchasers  of  certain  products. 

Automobile  owners  from  lists. 

Certain  classes  of  business  people  where  lists  are  available. 

Certain  types  of  stores. 

6.  Where  a  great  many  interviews  must  be  made  within  a  very  limited 
length  of  time  (as  during  the  course  of  a  given  radio  program,  or  when 
a  widespread,  quick  checkup  is  desired). 

7.  Where  definite  facts  alone  are  necessary. 

8.  Where  housewives  alone  are  to  be  interviewed. 

9.  Where  businessmen  must  be  reached  either  at  the  office  or  at  home. 

10.  As  a  check  on  radio  programs  heard  and  preferred. 

11.  In  preference  to  mail  questionnaires,  because  the  number  of  returns 
and  the  cost  per  return,  the  time  to  be  consumed,  and  the  type  of 
neighborhood,  can  all  be  controlled.  The  cost  is  rarely  greater  than 
mail  and  may  be  very  much  less. 

Telephone  Interviews  Should  Not  Be  Used 

1.  When  the  information  to  be  obtained  must  be  classified  as  to: 

Buying  power.     Age. 
Rental  value.       Nationality. 
Income.  Intelligence. 

Etc. 

2.  When  observation  is  an  important  factor. 

3.  When  the  questionnaire  is  lengthy  or  the  information  desired  is 
extensive,  there  is  little  advantage  in  cost  and  results  are  definitely 
less  accurate. 

1  Now  Market  Research  Corporation  of  America. 
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4.  When  an  analysis  of  attitude  is  desirable. 

5.  When  the  comment  and  interpretation  of  the  answers  vitally  affect 
the  results. 

6.  When  a  discussion  of  new  uses,  criticisms,  appeal,  etc.,  is  desirable. 

7.  When  the  interviewer's  intelligence  and  training  must  evaluate  and 
correct  the  answers  and  discard  the  palpably  questionable  or  false. 


BATTEN.  BARTON, 

3URSTINE  &  OSBORNE.  INC          No  answ„ 

uaie 

Interviewer; 

Wy 

Cduld  rot  talk 

No. 

Telephone 

*. 

Address 

RADIO 

KM  Program 
Heard 

If  Ifes, 
How  .Many  Times? 

f  Not,  Do  you 
Ever  Hear  It? 

HOW  DID  YOU  LIKE  IT? 

Heard  Sunday 
■i  Program 

Yes 

No 

Yes 

No 

12   3  4   5 

Yes 

No 

Yes 

No 

I 

2 

3 

4 

5 

6 

7 

8 

24 

25 

25 

Fig.  5. — Example  of  a  questionnaire  sheet  used  in  a  telephone  survey. 


ARNOLD 

wsm  MORNir 

RESEARCH  SERVICE 

JG  PROGRAM  RADIO  STUDY 

f.ity                                                        rniild  no!  talk 

• 

Name 

Address 

RADIO 

HH  Morning. 
Program  Heard 

Wrote  for 
Booklet 

Yes 

No 

Yes 

No 

Yes 

No 

— 

Fig.  6. — Example  of  a  questionnaire  sheet  used  in  a  telephone  survey. 


In  the  preparation  of  a  questionnaire  for  a  study  by  multiple 
personal  interviews  there  are  at  least  two  courses  which  might  be 
followed.     The  first  course  is  to  construct  at  once  a  complete 
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schedule,  resting  solely  upon  the  information  then  in  hand.  This 
is  probably  the  course  more  generally  followed.  When  carefully 
thought  out  in  the  light  of  adequate  experience  and  of  a  full 
consideration  of  the  psychological  aspect  of  the  questions,  this 


Type  of  neighborhood :  A B C 

1.  What  kind  of  gas  cooking  stove  have  you? 


2.  How  many  burners  has  it? 

2 3 4 6 

3.  How  many  baking  ovens  has  it? 

1 2 3 

4.  How  many  warming  ovens? 

1 2 3 

5.  How  many  broilers? 

1 2 3 

6.  Is  it  made  of  iron  or  enamel? 

Iron Enamel 


7.  How  long  have  you  had  it? 

Under  6  mo 

6  mo.-l  yr.  

1  year  

2  years  


3  years 

4  years 

5  years 
Over  5  years. 


8.  Do  you  live  in  a  house  or  an  apartment? 
House Apartment 


Yig.  7. — Example  of  a  questionnaire  used  for  a  telephone  survey. 

course  is  feasible;  but  only  if  the  questionnaire  is  carefully  tested 
in  advance  of  use. 

Safeguarded  by  such  tests  in  every  case,  this  method  of  pre- 
paring a  questionnaire  may  safely  be  used,  particularly  in  repeti- 
tive studies.  If,  for  instance,  a  number  of  studies  are  made 
dealing  with  the  same  subject  matter  (as  the  various  Newspaper 
Reader  Surveys  conducted  by  Dr.  Daniel  Starch  under  the  aus- 
pices of  the  American  Association  of  Advertising  Agencies)  with 
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STUDY  OF  RADIO  PROGRAMS 

(Interviews  to  be  obtained  on  Thursday — with  majority 
during  the  morning  hours) 


1.  Between  what  hours  were  you  using  your  radio  set  last  evening? 
(6  to  12) 

_  9:00  to    9:30  P.  M. 

_  9:30  to  10:00  P.  M. 

_10:00to  11:00  P.  M. 

_1 1:00  to  12:00  P.  M. 


.6:00  to  7:00  P.  M. 
_7:00to8:00P.  M. 
_8:00  to  8:30  P.  M. 
_8:30to9:00P.  M. 


2.  How  many  were  listening  in  your  home  last  evening? 
(Indicate  number  in  each  age  class) 


Under  18 

19  to  30 

31  to  50 

Over  50 

Total 

M          F 

M        F 

M        F 

M        F 

M    F 

3.  Name  the  programs  you  heard  last  evening  (Wednesday)  and  rank 

them  (1,  2,  3,  etc.)  on  the  basis  of  enjoyment  or  interest: 

Name  of  Program  Over  What  Station 

1 

2 

3 

4 


4.  What  would  you  say  are  the  three  best  programs  on  the  air?  (regard- 
less of  when  broadcast).     Why  do  you  consider  them  best? 


Name. 
City—. 


.No. 


JStreet. 


JState. 


Initials  of  Investigator. 


Fig.  8. — Example  of  a  questionnaire  used  in  a  telephone  survey. 
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Name. 


QUESTIONNAIRE 


Male- 


Form  5150-3 


.Female- 


Address. 
City 


.     Class  A- 

Date 


_C D- 

.Int.  Init 


Occupation  of  Head  of  House 

Check  here  if  "Farm"  interview_ 


.Where  Interview  was  made. 


.If  woman  self-supporting. 


.(Check) 


Educational  and  Cultural  Background 
High Medium Low 


Estimated  Age: 

15-20     

21-30     

31-40     

41-50     

Over  50 


SECTION  A:  JUICES  IN  GENERAL:  Fruit  and  Vegetable.      Canned  and  Fresh. 

1.  What  do  you  think  of  fruit  and  vegetable  juices? 

2.  What  do  you  think  of  the  value  of  fruit  and  vegetable  juices  as  a  whole? 

3.  Which  fruit  juice,  if  any,  do  you  use  in  your  home? 

4.  What  are  your  reasons  for  using  fruit  juices? 

5.  How  long  have  you  used  the  various  fruit  juices? 

6.  Do  you  use  the  same  juice  all  of  the  time  or  do  you  use  one  kind  for  a  while  and  then 
another,  or  do  you  rotate  several  different  types? 

7.  Are  there  any  juices  of  any  sort  which  you  or  any  members  of  your  family  do  not 
like  and  why? 

8.  Are  there  any  fruit  and  vegetable  juices  you  have  used  and  stopped  using?  If  so, 
why? 

9.  If  you  do  not  use  fruit  or  vegetable  juices  is  there  some  reason  for  this? 

10.  If  you  do  not  use  fruit  juices,  what  takes  their  place  in  the  diet  of  your  family? 

11.  Why  do  you  prefer  these  articles  of  diet  instead  of  fruit  juice? 

12.  Discuss  the  relative  merits  of  fresh  fruit  (such  as  oranges,  apples,  pears,)  fresh 
fruit  juices  (such  as  orange  juice,  grapefruit  juice)  and  canned  fruit  juices  (such  as 
prune  juice,  canned  pineapple  juice). 

13.  Do  you  know  of  anyone  who  has  had  unfortunate  experiences  with  any  kind  of 
fruit  juices? 

14.  What  would  be  your  idea  as  to  what  is  the  most  stylish  or  fashionable  fruit  or  fruit 
juice? 

15.  Do  you  think  that  any  of  the  above  juices  are  a  fad  or  do  you  feel  that  they  are 
here  to  stay? 

SECTION  B:  TOMATO  JUICE 

16.  What  brands  of  tomato  juice  have  you  ever  used? 

17.  How  long  have  you  used  each  brand? 

18.  What  do  you  like  about  it? 

19.  What,  if  anything,  do  you  dislike  about  it? 


Fig.  9. — Sample  of  a  preliminary  questionnaire. 
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20.  How  often  do  you  serve  it?     Give  answer  in  days.     Every days. 

21.  At  what  meals  is  tomato  juice  served? 

22.  Is  it  used  at  times  other  than  at  meals? 

23.  How  much  is  served  per  person  at  each  of  these  occasions? cups. 

SECTION  C:  PINEAPPLE  JUICE — Questions  in  this  section  apply  to  Pineapph 
Juice  ONLY 

24.  What  do  you  think  about  pineapple  juice? 

25.  What  brands  of  pineapple  juice  have  you  ever  used?      Brand  now  used 

Other  brands 


.months. 


26.  How  long  have  you  used  the  brand  you  are  now  using? yeai 

27.  What  do  you  like  about  it?     What  particular  features  of  that  brand  are  liked  by 
various  members  of  your  family? 

28.  What,  if  anything,  did  you  dislike  about  it? 

29.  What  brands,  if  any,  did  you  formerly  use  and  give  up  using? 

30.  At  what  meals  is  pineapple  juice  served? 

31.  Is  it  used  at  times  other  than  at  meals? 

32.  How  much  is  served  per  person cups,  at  each  of  these  occasions?      Try  to  get 

the  answer  in  cupfuls  as  in  the  case  of  tomato  juice. 

33.  What  is  the  form  in  which  you  serve  it? 

34.  Do  you  use  any  special  recipes? 

35.  Do  you  ever  dilute  it  with  water  or  ice? 

36.  Do  you  ever  mix  pineapple  juice  with  alcoholic  drinks  for  cocktails,  etc.? 

37.  How  often  do  you  serve  it?     Give  the  answer  in  days.     Every days. 

38.  How  did  you  first  come  to  learn  of  the  brand  of  pineapple  juice  which  you  are  now 


39.  Was  it  recommended  by  someone? 

40.  Have  you  ever  recommended  it  to  anyone  else? 

41.  Have  you  ever  experienced  anything  unfavorable  about  this  brand  or  heard  any- 
thing unfavorable  about  it? 

42.  How  often  do  you  buy  pineapple  juice?     Every days. 

43.  In  what  quantities  do  you  purchase  it? cans. 

44.  Where  do  you  purchase  it?     State  type  of  store. 

THE  FOLLOWING  QUESTIONS  ARE  TO  BE  ASKED  OF  ALL  RESPONDENTS: 

45.  Do  you  believe  that  canned  pineapple  juice  is  the  same  product  as  the  sirup  which 
is  contained  in  cans  of  sliced  pineapple? 

46.  Is  it  your  impression  that  pineapple  juice  is  a  relatively  expensive  or  inexpensive 
product?  inexpensive expensive 

47.  Have  you  ever  used  Dole  Pineapple  Juice?     State  experiences. 

48    Is  there  any  distinguishing  mark  or  symbol  on  the  DOLE  PINEAPPLE  JUICE 
can  or  DOLE  PINEAPPLE  can? 

^r-  j,^  g — (Continued) 
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the  same  objectives,  handled  by  the  same  research  organization, 
with  the  same  technique,  but  separated  as  to  time  and  place,  the 
schedule  of  questions  for  each  new  survey  might  safely  be  built 
upon  its  predecessor.  Even  in  such  cases,  however,  judgment  is 
required  in  determining  what  differences  the  change  in  time  and 
place  could  make  and  in  adjusting  the  questionnaire  accordingly. 

The  second  course,  which  in  complicated  cases  is  certainly  the 
more  dependable,  is  to  build  a  preliminary  questionnaire  in  which 
is  included  every  conceivable  question  that  can  by  even  remote 
chance  have  any  bearing  on  the  problem. 

This  is  a  somewhat  newer  course  but  has  been  used  effectively 
in  a  number  of  cases.  Because  it  represents  something  of  an 
innovation,  we  are  giving  in  Fig.  9  an  illustration  of  this  method 
of  preparing  a  questionnaire.  The  questions  on  this  schedule, 
about  fifty  in  number,  were  asked  in  some  five  hundred  homes. 
This  was  a  preliminary  to  the  preparation  of  a  questionnaire 
intended  ultimately  for  ten  thousand  homes. 

It  will  be  noted  that  in  this  preliminary  schedule  every  point 
which  could  possibly  have  bearing  on  the  subject  has  been 
included.  This  was  not  with  the  idea  of  obtaining  answers  to 
each  question — but  to  eliminate  the  ineffectual  ones,  to  bring 
the  schedule  down  to  the  most  practical  limits,  to  guide  the  work 
of  the  interviewers  and  to  facilitate  the  effective  organization 
of  the  data. 

In  developing  this  questionnaire  for  its  proposed  extensive  use, 
the  original  five  hundred  interviews  were  analyzed  statistically 
on  some  points  while  the  qualitative  remarks  on  other  points  were 
carefully  classified  and  studied  as  to  thought  content.  This 
process  made  it  possible  to  determine  with  the  maximum  reli- 
ability: Which  points  were  pertinent  to  the  study  and  in  what 
degree;  on  which  subjects  the  housewives  were  articulate;  and 
on  which  points  they  had  information  of  real  importance  to  offer. 
Further,  it  disclosed  where  and  how  the  form,  sequence  and 
intent  of  each  question  might  be  improved;  in  what  manner  the 
responses  to  the  various  questions  would  later  lend  themselves 
to  organization  and  what  contribution  each  question  might  make 
to  the  effective  interpretation  of  the  study. 

This  method  has  obvious  advantages  in  many  problems.  Par- 
ticularly is  this  true  in  cases  which  involve  a  number  of  related 
lines  of  thought  more  or  less  germane  to  the  final  objectives 
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of  the  study.  In  the  case  illustrated,  these  "  several  lines  of 
thought' '  include  Juices  in  General — Fruit  or  Vegetable,  Fresh 
or  Canned;  Tomato  Juice;  Pineapple  Juice. 

This  idea  of  a  preliminary  questionnaire  takes  out  more  of  the 
guesswork  and  generally  simplifies  the  whole  process.  In  the 
case  used  here  as  an  illustration,  the  several  pages  of  tentative 
questions  were  reduced  to  a  single  sheet  of  about  twenty  points, 
as  shown  in  Fig.  10.  This  process  of  reduction  requires  con- 
siderable judgment,  too;  only  those  questions  may  be  retained 
which  logically  result  in  the  most  significant  and  reliable  answers 
and  those,  of  course,  must  be  expressed  in  precisely  the  most 
appropriate  form. 

In  this  case,  the  short  questionnaire  was  not  only  adequate  for 
the  study  but  proved  more  workable  for  the  interviewer  and  the 
respondent  and  made  both  the  tabulation  and  the  analysis  of 
the  many  thousands  of  interviews  simpler  and  more  effective. 

In  developing  a  questionnaire  for  actual  working  purposes, 
there  are  two  other  ideas  to  be  considered.  Either  of  them 
may  fit  a  given  study  better  than  the  other.  The  first  idea 
regards  the  interrogatory  method  or  form  as  most  conducive  to 
full  and  accurate  information  in  all  studies.  This  is  the  older 
practice  and  probably  prevails  in  the  majority  of  studies  being 
made  to-day. 

The  other  idea  might  be  called  the  declarative  method  or  form. 
It  proceeds  on  the  theory  that  some  studies  come  closer  to  the 
truth  if,  instead  of  questions,  a  series  of  possible  answers  is 
addressed  to  the  respondent  on  each  point.  This  method  is 
susceptible  of  considerable  development.  , 

In  using  this  type  of  questionnaire,  the  answers  are  sometimes 
read  off  to  the  respondent  who,  by  declaration,  identifies  his  own 
experience  or  reaction  with  one  of  the  answers  on  each  point;  in 
other  cases  a  list  of  the  answers  is  handed  to  the  respondent,  who 
checks  those  appropriate  on  each  point;  and  in  some  cases  the 
respondent  is  allowed  to  declare  his  reactions  in  his  own  words, 
the  interviewer  fitting  them  to  the  appropriate  answers  on  the 
schedule. 

In  using  the  second  method  some  discretion  is  required  in 
each  case  in  determining  whether  to  submit  to  the  respondent 
any  list  of  possible  answers.  If  information  is  being  sought  on 
such  a  matter  as:  "what  brand  of  laundry  soap  is  used"  in  a  home, 
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there  is  comparatively  little  danger  in  listing  the  most  popular 
brands  and  allowing  the  housewife  herself  to  check  those  she  is 
currently  using.  In  fact,  this  may  be  the  more  reliable  way; 
because,  if  such  a  question  were  asked  by  the  interviewer,  he 
might  be  led  by  habit  into  mentioning  some  popular  brand  too 
early  in  the  interview  or  too  frequently  and  omitting  lesser 
known  brands  entirely.  Similar  unintentional  distortions  might 
also  affect  the  length  of  time  certain  designated  brands  are 
reported  to  have  been  in  use;  and,  in  fact,  they  may  affect  any 
data  which  may  be  governed  by  such  explicit  factors  as  use, 
time,  place,  etc. 

On  the  other  hand,  if  it  is  desired  to  ascertain  the  reasons 
actuating  the  choice  of  a  brand,  it  would  be  manifestly  unsafe 
to  present  the  list  directly  to  the  respondent.  The  housewife 
could  not  be  expected  instantly  to  concentrate  and  analyze  her 
motives.  Unquestionably,  she  would  do  the  easiest  thing.  She 
would  simply  check  off  the  answers  which,  at  the  moment,  seemed 
to  her  the  most  plausible.  In  studies  of  this  sort,  where  the 
declarative  method  is  used,  it  would  be  sounder  practice  to 
require  the  interviewer  to  read  the  question,  give  the  respondent 
time  to  comprehend  it  and,  then,  report  the  answer  verbatim 
and  in  full. 

A  development  of  the  declarative  type  of  questionnaire  was 
recently  made  in  connection  with  attitude  studies:  A  schedule 
was  constructed  of  a  number  of  simple  declarative  sentences  on 
each  of  which  the  respondent  was  asked  to  state  agreement, 
neutrality,  or  disagreement  and  also  to  indicate  the  intensity  of 
such  agreement  or  disagreement. 

For  instance,  in  a  study  of  the  educational  value  of  advertising, 
its  reliability  in  a  general  sense,  its  social  significance,  its  cost 
and  its  control,  the  schedule  consisted  of  a  series  of  declarations 
equally  divided  between  favorable  and  unfavorable  attitudes 
on  each  point.  In  devising  this  type  of  schedule,  it  is  planned  to 
score  or  "  weight"  the  responses.  In  the  case  in  point,  for  exam- 
ple, a  simple  agreement  to  a  favorable  declaration  was  given  a 
score  of  "plus  one,"  while  a  strong  agreement  was  given  a  score  of 
"plus  two";  agreement  to  an  unfavorable  declaration,  however, 
was  given  a  score  of  "minus  one"  or  "minus  two,"  according  to 
the  intensity  of  agreement.  Disagreement  with  an  unfavorable 
declaration  was  also  scored  "plus  one"  or  "plus  two,"  according 
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to  degree;  while  disagreement  with  a  favorable  factor  was  given  a 
minus  score.  A  doubtful  or  neutral  response  was  given  a  zero. 
This  is  the  type  of  questionnaire  shown  in  Fig.  11. 

A  study  based  upon  a  schedule  of  this  sort,  with  its  provision 
for  adjusting  the  weighted  replies,  would  quite  probably  lead 
to  a  sound  estimate  of  the  public  attitude  toward  the  whole 
subject  of  advertising. 


ome  a  complete  mechanibtr 
of  the  wheel  -  bones, 
human  temperaments,  in- 

11  be  taken  into  account 


ADJUSTABLE  FRONT  SEAT 

Adjustable  back  and  forth  for 
different  leg  lengths.  Also 
helps  relieve  musole  fatigue, 
by  permitting  you  to  change 
your  position  while  driving. 

Does  your  PRESENT  CAR  have  this  feature? 

□  yes        Qno 

Would  you  want  it  on  your  NEXT  CAR? 
fj  YES       fj  NO       Q  g»SiT 


DASH  COMPARTMENT 


In  some  of  the  new  cars  the  instruments 
are  grouped  at  the  left  with  a  parcel 
oompartment  at  the  rjght. 

Does  your  PRESENT  CAR  have  this  feature? 

□  yes        Qno 

Would  you  want  It  on  your  NEXT  CAR? 

□  ^S     Q  NO     □  g;si» 


NO  DRAFT  VENTILATION 


The  passenger  beside  the  ventilator  enjoys  fresh 
air  without  drafts  swirling  across  the  whole 
seat.  Smoke  and  used  air  are  instantly  drawn 
outside  by  the  vaouum  sat  up  at  rear  edge  of 
ventilator. 

Does  your  PRESENT  CAR  have  this  feature? 

□  yes        Qno 


Would  you  want    it  on 
□  YES  Q  NO 


NEXT  CAR? 

n  don't 

I I  CAM 


SYNCRO-MESH  TRANSMISSION 


irevents  olashlng  of  gears. 
Ilakes  gear  shifting  easy 
and  smooth.  * 


Doe*  your  PRESENT  CAR  have  thla  feature? 

□  yes        Quo 

Would  you  want    it   on  your   NEXT  CAR? 
□  YES  □  NO  □  g23iT 

*A  smooth  working  mechanism    lasts    longer. 


Perhaps  some  of  your   friends  would    like  a 
copy     of   this  booklet     -     See     page  23     - 


Fig.  12. — Example  of  pictorial  questionnaire. 

Another  innovation  in  connection  with  questionnaires,  intro- 
duced during  the  past  few  years,  is  the  pictorial  form.  This 
form  has  been  referred  to  in  discussing  the  psychological  con- 
siderations involved  in  building  questionnaires.  Examples  are 
shown  in  Fig.  4,  as  used  by  a  magazine  in  a  study  of  its  reader- 
ship, and  in  Fig.  12,  as  used  by  the  General  Motors  Corporation 
in  its  consumer  research.  The  purpose  of  the  magazine  ques- 
tionnaire was  simply  to  attract  attention  and  to  interest  its 
readers  in  replying;  the  latter  schedule  was  designed  for  the 
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broader  purpose  of  visualizing  to  the  consumer  the  precise 
mechanical  points  on  which  data  were  being  sought — and  to  do 
this  in  such  a  manner  as  to  make  unnecessary  any  involved  dis- 
cussion of  the  parts  of  the  car.  This  was  the  same  idea  which 
prompted  the  use  of  a  diagram  in  the  study  of  shoes  referred  to 
on  page  68. 

In  the  preparation  of  the  final  schedule,  decisions  must  be 
made,  therefore,  as  to  whether  the  questionnaire  is  to  be  inter- 
rogatory or  declarative  in  form  or  a  combination  of  the  two  meth- 
ods. In  any  case,  due  consideration  must  be  given  to  all  the 
factors  mentioned  in  this  chapter,  to  all  the  psychological  require- 
ments inherent  in  the  situation  and  suggested  in  Chaps.  Ill  and 
IV —  as  well  as  to  all  the  other  factors  mentioned  under  the 
subject  of  the  Questionnaire  beginning  on  page  117. 

Since  the  organization  of  data  is  of  equal  and  concurrent 
importance,  it,  too,  must  be  considered  at  every  point  in  the 
building  of  a  questionnaire.  This  is  true  particularly  of  the 
physical  aspects  of  the  schedule,  its  scope,  its  length,  its  orderly 
setup  and  other  features  which  might  tend  to  facilitate  the  han- 
dling of  large  numbers  of  completed  questionnaires  during  the 
tabulation  phase.  Successful  interpretation,  too,  begins  with 
the  questionnaire,  as  has  been  clearly  shown  in  the  section  of 
Chap.  Ill,  which  begins  on  page  75. 

In  a  specific  case  it  is  probable  that  in  the  stage  of  planning, 
decision  will  have  been  reached  as  to  whether  the  tabulation 
should  be  made  by  hand  or  by  machine.  If  it  is  made  by  hand, 
the  tabulation  may  be  expedited  by  having  some  type  of  code 
given  to  those  answers  which  can  reasonably  be  anticipated.  If 
machine  tabulation  is  indicated,  as  many  of  the  answers  as 
possible  should  certainly  be  precoded. 

It  will  be  found  sometimes  that  neither  the  complete  precoding 
nor  complete  omission  of  codes  is  feasible;  for  the  best  results 
such  questionnaires  require  a  judicious  combination  of  the  two 
methods.  The  coding  is  usually  done  in  advance  of  the  field 
work  but  it  may  also  be  done  after  the  questionnaires  are  returned 
and  when  the  coding  requirements  can  be  more  accurately  deter- 
mined. Coding  for  machine  tabulation  is  described  in  a  special 
chapter  on  mechanical  tabulation  which  begins  on  page  248;  and 
coding  for  "hand  tabulation"  is  again  referred  to  in  connection 
with  the  editing  of  finished  questionnaires. 
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DRY  CLEANING  SURVEY  Form  5111-2 

CONSUMERS 


Name Age  No.  in  Family  Home 

Address Under  25 Adult  Males A 

City 25-40       Adult  Females B 

Sex :  Male Female Over  40  Children  C 

1.  Approximate  amount  of  dry  cleaning  in  average  month: 

Men's  suits (If  unable  to  give  number)  What 

Women's  one-piece  dresses is  approximate  monthly  cleaning 

Other  pieces bill? 

Can't  say $ Can't  say 

2.  What  proportion  of  dry  cleaning  is  done  at  home: 

All  done  at  home All  sent  to  cleaners 

Some  sent  to  cleaners Per  cent 

3.  Give  name  of  dry  cleaner  she  uses  for  best  garments 

4.  Why  does  she  use  this  particular  cleaner? . 


5.  What  other  dry  cleaner  does  she  use?     (Name). 

6.  Why  does  she  use  this  cleaner? 


7.  How  long  has  she  been  sending  work  to  these  cleaners? 
Best  Cleaner  Other  Cleaners 

1  mo.  or  less 1  mo.  or  less 

1-3  months  1-3  months  

3-6  months  3-6  months 

6-12  months 6-12  months 

1-2  years   1-2  years   

Over  2  years Over  2  years 


If  she  has  changed  cleaners  within  past  2  years,  what  was  the  reason? 
Best  cleaner — 


Other  cleaner_ 


What  does  she  pay  her  best  dry  cleaner  for  cleaning: 
Men's  suits Women's  one-piece  silk  dress. 


10.  Does  she  consider  these  charges:  High Reasonable Low 

11.  Does  she  have  charge  account  with  best  cleaner Other  cleaner 

12.  What  is  the  highest  price  she  knows  of  that  any  cleaner  is  charging  for : 

Men's  suits  $ Women's  one-piece  silk  dress  $ 

13.  What  is  the  lowest  price  she  knows  of  that  any  cleaner  is  charging  for: 

Men's  suits  $ Women's  one-piece  silk  dress  $ 


Fig.  14. — Example  of  questionnaire  with  no  precoding. 
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14.  How  does  she  judge  whether  her  cleaner  has  done  a  good  job?. 


15. 


In  what  particulars  does  she  observe  the  greatest  difference  between 
the  work  of  the  more  expensive  and  the  cheaper  dry  cleaners  ?  (Rank 
by  number  in  order  of  importance.) 


16. 


17. 


18. 
19. 
20. 


Lack  of  odor 

Spots  removed. 
No  shrinkage- 


Appearance  restored. 

Shape  restored 

Color  restored 


Feel  of  the  goods 

Complete  cleanness. 


Better  finish  and  press. 
Other 


What  special  process  does  her  best  dry  cleaner  use? 

Name  of  Process Don't  know 

If  named:  Does  she  consider  this  process  better  than  ordinary  dry 
cleaning? 

Definitely  better Uncertain Not  better 


Has  she  ever  heard  of  the  SANITONE  process? 
If  yes,  How?. 


Yes_ 


.No_ 


Does  she  see  much  advertising  by  dry  cleaners  in  her  city? 
Considerable. Very  little None 


21.  Laundry  Work:  What  difference  (if  any)  has  she  observed  in  the 
appearance  of  work  returned  by  different  commercial  laundries  she 
has  used? 


22.  Remarks: 


MARKET  RESEARCH  CORPORATION  OF  AMERICA 

Rockefeller  Center, 
1250  Sixth  Avenue  New  York,  N.Y. 


Fig.  14. — Example  of  questionnaire  with  no  precoding. — (Continued) 
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HOUSEHOLD  EDITOR'S  DEPARTMENT 
1— DO  YOU  PUT  UP  JAMS  OR  JELLIES?     Yes 361     No. 


362 


(If  "no,"  skip  to  question  22) 
2 — What  kinds  of  jams  and  jellies  do  you  make?      (Check  under  10) 
3 — How  many  glasses  of  each?      (Check  under  10) 

4 — Before  starting  to  make  jelly  do  you  ever  test  your  raw  juice  to  see  if  it  will  jell' 
Yes 371     No _372 


IF  YES  5— How? 

IF  NO    6 — What  test  have  you  ever  heard  of?_ 


7 — Do  you  have  any  way  of  testing,  before  you  pour,  to  make  sure  the  batch  will  jell? 
Yes 401     No 402 


8 — If  so,  how?_ 


9 — Have  you  ever  used  grape  juice  or  canned  or  dried  fruits  to  make  jams  or  jellies? 

Yes 421     No 422 

10 — In  which  of  your  jellies  (jams)  does  your  recipe  call  for  anything  besides  the  fruit 
juice  and  sugar? 

(Use  (Use 

(Number  of  Certo)         Apples) 

glasses  put  up)  (Yes)  (Yes) 


(Fruits) 


(Use  Other 

Materials) 

What? 


Apples 

7 
9 

Blackberries 

11 
13 

IS 

Cranberries 

17 
19 

21 

Gooseberries 

23 
2R 

Marmalade 

27 
29 

31 

33 

3R 

37 

Raspberries 

39 

41 

Strawberries 

43 

Others  (specify). 


■11— What  is  Certo?      Definition. 


IF  CERTO- 

IS  -  -  ..    -    .. 

MENTIONED       12 — (If  Certo  used  only  in  some.)      Why  don't  you  use  Certo  in  the 
other  jellies  (jams)  you  make? 

13 — About  how  many  bottles  of  Certo  do  you  use  in  a  year? 


14 — About  how  much  does  jelly  made  with  Certo  cost  per  glass? 

. c     Don't  know 

(Skip  to  Question  26) 


IF  CERTO- 
IS  NOT 


->15 — About  how  long  does  it  take  to  cook  a  batch' 


16 — About   how   much    does    your   jelly    cost    per    glass?. 

MENTIONED  Don't  know 

17 — Do  you  know  what  Certo  is?     Yes 531     No_ 

18 — Definition 


.532 


Fig.  15. — Example  of  questionnaire  precoded  only  in  part. 
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19 — Have  you  ever  used  Certo?     Yes_ 
20 — Why  didn't  you  continue  using  it?. 


_551     No. 


.552 


21 — About  how  much   do   you  think   Certo   costs'; 

idea 

(Skip  to  Question  26) 


_c     No 


22— HAVE  YOU  EVER  PUT  UP  JELLIES  OR  JAMS?     Yes 591     No. 

IF  YES         23 — Why  did  you  stop?__ 


24 — When  did  you  stop' 


IF  NO  25 — Why  haven't  you  tried  putting  them  up?. 


26— DO  YOU  EVER  BUY  ANY  JELLIES  OR  JAMS  ?     Yes_ 


_631     No. 


632 


(If  "No"  to  1  and  26,  jump  to  32.     If  "Yes"  to  1,  but  "No"  to  26,  jump  to  29.) 

27 — About  how  many  glasses  do  you  buy  a  year? gh 

28 — Why  do  you  buy  these  instead  of  making  them? 


29 — At  what  meals  do  you  serve  jellies?     (Check  when) 

Breakfast— 671     Lunch  or  Supper_ 

Dinner_ 672     Between  Meals — 

30 — At  what  meals  do  you  use  jams? 

Breakfast— 681     Lunch  or  Supper. 

Dinner . 682     Between  Meals — 

31— DO  YOU  SERVE  JELLIES  OR  JAMS?     (Check  how) 
On  bread,  toast,  rolls,  etc 691     With  meats 


673 
.674 


683 
.684 


In  making  desserts  or  cakes 694     In  Salads. 

Other  ways  (how) — 


693 


(Omit  next  question) 
32— WHY  IS  IT  YOU  NEVER  SERVE  JELLY  OR  JAM?. 


33—COMMENTS  ABOUT  CERTO  (Get  them  in  full) 


City- 
Poor. 


A.ddress_ 


Middle  Class. 
Wealthy 


.731     American 

.732     Foreign  born. 
_733     Colored 


.741  Farm_ 
.742  Village. 
.743     Town_ 


Age  of  Woman — 

Under  35 

35  to  60 

Over  60 


.761  Eastern— 
.762  Southern. 
_763     Texas 


Medium  City- 
Large  City 

.771     Middle  West_ 

.772     Coast 

.773 


.751 
.752 
.753 
.754 
755 
.774 
.775 


FlG<  15— Example  of  questionnaire  precoded  only  in  part.— (Continued) 
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For  the  purpose  of  illustration,  Figs.  13,  14,  15  present  three 
different  forms  of  questionnaires  showing:  First,  an  elaborate  one 
almost  completely  precoded;  then,  one  entirely  without  coding; 
and  a  third  in  which  only  some  of  the  items  are  coded. 

It  will  be  noted  that  in  the  exhibit  last  shown  the  questions 
having  to  do  with  the  reasons  why  are  among  those  on  which  cod- 
ing has  been  omitted.  This  is  necessarily  so  except  in  cases  in 
which  it  can  be  ascertained  in  advance  just  what  reasons  are 
likely  to  be  ascribed.  If  experience  has  shown  that  all  the  reasons 
for  a  certain  action  or  attitude  fall  within  seven  known  classes,  for 
example,  these  seven  classes  could,  of  course,  be  coded  as  sub- 
divisions of  that  question.  Otherwise  such  a  question  could 
not  be  coded.  The  subject  of  coding  is  further  elaborated  and 
illustrated  in  Chap.  XIV. 

The  preparation  of  work  sheets  will  be  resumed  for  discussion 
under  the  general  subject  of  Organizing  the  Data.  It  is  in  con- 
nection with  that  phase  of  a  research  program  that  work 
sheets  are  used. 


CHAPTER  VIII 
ORGANIZATION  OF  PERSONNEL 

(Elaboration  of  Chart  F,  page  108,  Continued) 

A  permanent  field  staff  for  the  collection  of  unrecorded  data 
may  be  built  up  gradually,  one  or  two  persons  at  a  time,  and  held 
ready  to  function  on  any  problem  assigned  to  it  by  the  research 
agency  controlling  it.  Or,  under  urgent  circumstances,  a  tem- 
porary field  staff  may  be  put  together  in  its  entirety  and  specif- 
ically for  a  single  study.  In  either  event  certain  factors  must 
present  themselves  for  consideration,  first  in  selecting  the  persons 
who  are  to  do  the  work  and  then  in  equipping  them  for  it. 

Organization  {Continued).  Cognizance  must  again  be  taken 
of  the  four  basic  methods  of  collecting  data.  As  these  determine 
the  kind  of  questions  and  other  characteristics  of  the  schedule, 
they  also  affect  the  selection  and  training  of  the  persons  who  are 
to  handle  the  questionnaire. 

selection  of  field  personnel.  A  study  by  "  direct  investi- 
gation, "  for  instance/ requires  no  field  staff  in  any  general  sense. 
A  study  by  "  mailed  questionnaires  "  involves  at  this  stage  nothing 
more  than  a  purely  clerical  force. 

A  study  by  "  telephone  inquiry,"  however,  does  entail  some 
careful  consideration  in  the  selection  of  the  persons  to  make  the 
inquiry.  Generally  speaking,  such  an  interviewer  must  have  all 
the  qualifications  required  for  personal  interviews,  plus  what 
might  be  called  a  "  telephone  personality,"  a  pleasing  manner  and 
a  firm,  strong,  resonant  and  flexible  voice.  Some  technical 
training  in  speaking  or  singing  should  be  almost  a  positive  requi- 
site. As  suggested  elsewhere,  every  applicant  otherwise  accept- 
able should  be  put  through  a  test;  he  or  she  should  be  required  to 
contact  the  research  office  three  or  four  different  times  and  go 
completely  through  the  script. 

As  has  been  suggested  in  Chap.  II  on  Planning  the  Procedure, 
a  study  by  "multiple  personal  interviews"  involves  some  factors 
which  are  entirely  outside  the  character  of  the  interviewer  himself. 

149 
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These  factors  involve  such  circumstances  as  the  race,  age,  sex, 
intellectual  plane,  social  position,  occupation  and  area  of  residence 
of  the  persons  to  be  interviewed.  When  these  factors  are  known 
or  can  be  anticipated,  the  selection  of  interviewers  becomes  a 
matter  of  fitting  the  characteristics  of  the  interviewer  to  the 
situation  in  the  field.  It  would  be  entirely  feasible,  for  example, 
to  have  a  properly  qualified  Negro  interviewing  colored  respond- 
ents.    But  such  a  person  should  interview  no  white  people. 

There  should  be  some  relationship,  too,  between  the  ages  of 
the  interviewers  and  the  interviewees.  For  example:  If  adoles- 
cents are  to  be  interviewed,  the  reporter  should  be,  as  nearly  as 
practicable,  a  contemporary.  If  the  reporter  be  noticeably 
beyond  the  magic  age  of  youth,  the  unfledged  interviewee  may  be 
overreticent  or  overexpansive,  depending  upon  his  or  her  dis- 
position at  the  time.  Nor  should  older  people  be  interviewed  by 
persons  palpably  too  young  or  too  immature  or  frivolous. 

In  general,  the  selection  of  a  field  staff  for  a  study  by  personal 
interview  should  be  governed  by  such  considerations  as  the 
following.     A  marketing  research  interviewer  should  have: 

1.  Better  than  average  education. 

2.  Pleasing  appearance  and  manner. 

3.  Experience  in  the  problems  of  business,  sales,  advertising,  merchan- 
dising and  allied  lines.  . 

4.  Ability  to  contact  people  of  all  classes  easily. 

5.  Insatiable  curiosity  and  an  inquiring  mind  which  can  be  satisfied  only 
by  the  reasons  back  of  the  facts. 

6.  An  ability  to  record  with  precision,  and  without  color  or  bias,  infor- 
mation obtained  from  others. 

7.  The  faculty  for  accurate  observation  and  a  conscientious  regard  for 
details. 

8.  A  real  sympathy  and  interest  in  the  problems,  attitudes  and  opinions 
of  others. 

9.  Absolute  honesty  and  reliability. 
10.   A  retentive  memory. 

A  combination  of  all  these  characteristics  in  just  the  right 
proportions  would  represent  the  ideal.  Probably  no  such  inter- 
viewer exists.  One  can  expect  only  to  approach  perfection; 
nevertheless,  some  combination  of  these  attributes  must  be 
regarded  as  an  irreducible  minimum.  Precisely  what  this  com- 
bination should  be  in  any  given  case  has  never  been  scientifically 


ORGANIZATION  OF  PERSONNEL  151 

worked  out.  Comprising,  as  it  does,  the  factor  of  human  rela- 
tions, the  selection  of  a  good  interviewer  is  in  the  last  analysis  an 
individual  problem;  there  can.be  no  cut  and  dried  rules  by  which 
selection  may  be  made,  but  the  above  list  indicates  the  per- 
sonal faculties  which  are  most  desirable.  Some  of  them  are 
indispensable. 

Where  a  staff  already  exists  or  where  there  is  time  to  assemble 
a  staff  with  deliberation,  the  problem  of  selection  is  fairly  simple. 
But  where  the  study  requires  a  new  and  perhaps  hurriedly 
recruited  field  organization  for  a  specific  job,  selection  may 
entail  real  difficulty.  It  has  been  suggested  (in  Chap.  II)  that 
under  circumstances  of  this  sort  recourse  has  successfully  been 
had  to  the  superintendent  of  the  local  public  school  system. 

Even  within  a  group  of  competent  teachers,  however,  there 
will  frequently  be  a  choice  between  different  persons  as  to  which 
is  the  better  suited  to  work  on  a  particular  type  of  interview. 
It  is  not  wise,  however,  to  believe  that  one  can  use  a  less  experi- 
enced and  less  qualified  interviewer  for  consumer  investigations 
than  might  be  used  for  other  types.  Even  in  the  simplest  inter- 
views there  is  an  advantage  in  using  a  competent,  seasoned 
investigator.  Such  a  person  will  instinctively  grasp  the  whole 
purpose  of  the  work;  he  will  perceive  pertinent  points  not 
expressly  required  by  the  questionnaire  and  is  likely  to  develop 
considerable  additional  and  useful  information. 

No  stupid  or  illiterate  person  should  be  assigned  to  interview 
people  of  high  culture  and  intellectuality;  nor  should  the  inter- 
viewers be  so  far  above  the  respondent  in  culture  as  to  make 
difficult  a  true  and  unrestrained  communication  of  ideas. 

The  social  position  of  the  person  to  be  interviewed  is  one  of 
the  most  troublesome  factors.  There  is  always  a  "Gold  Coast" 
or  a  "Park  Avenue"  or  a  "Boulevard,"  where  the  people  live 
in  great  homes  and  apartments,  so  "garrisoned"  as  to  discourage, 
if  not  actually  to  frustrate,  the  approach  of  so  lowly  a  person  as 
a  research  worker.  Nevertheless,  what  our  American  "royalty" 
does  and  thinks  is  frequently  of  great  moment  in  a  marketing 
study. 

Sometimes,  indeed,  people  of  this  class  are  entirely  beyond 
reach  of  a  personal  research  interview.  They  have  too  many 
pressing  social  activities.  With  such  respondents  better  results 
can  probably  be  had  by  telephoning  the  inquiries.     This  method 
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has  been  employed  in  several  studies  relating  to  the  attend- 
ance, and  the  factors  influencing  such  attendance,  at  the  largest 
and  most  fashionable  hotels  and  supper  rooms  in  New  York. 

In  these  cases  social  registerites,  being  customarily  articulate 
over  the  telephone,  talked  willingly  and  at  length  on  the  questions 
presented  to  them  and  gave  a  great  deal  of  illuminating  and 
detailed  information.  To  have  reached  them  for  a  personal 
interview  would  have  been  very  difficult. 

There  are  some  types  of  information  concerning  households  of 
this  class — such  as  their  food  preferences — which  might  be 
obtained  by  personal  approach  and  with  complete  reliability 
from  butlers  or  housekeepers,  whose  positions  qualify  them  to 
speak  with  even  greater  knowledge  and  experience  than  their 
employers.  In  some  cases  social  secretaries,  too,  may  be  relied 
upon  for  data  within  their  fields. 

Where  the  subject  of  a  study,  however,  definitely  demands  an 
expression  direct  from  the  chatelaine  herself,  and  where  the 
objective  is  worth  while,  it  should  be  possible  on  some  basis — as 
for  a  donation  to  a  popular  charity — to  induce  some  socially 
acceptable  ladies,  perhaps  of  the  Junior  League  type,  to  make  the 
required  number  of  calls  in  such  exclusive  homes. 

Consideration  must  also  be  given  to  sex.  As  a  rule,  a  good 
interviewer  is  a  good  interviewer,  regardless  of  sex,  but  there 
are  some  types  of  jobs  for  which  one  or  the  other  is  more  naturally 
suited.  In  general,  it  is  probably  preferable  to  allow  women 
to  interview  housewives,  always  provided,  of  course,  that  they 
are  good  interviewers  in  the  first  place.  The  woman  reporter 
has  usually  had  some  domestic  background  and  some  experience 
with  the  problems  the  housewife  is  facing  and  her  knowledge  of 
the  subjects  to  be  discussed  may  be  regarded  as  thoroughly 
practical ;  it  is  easier  for  a  woman  to  get  into  the  home  and  easier 
for  a  woman  to  elicit  the  housewife's  confidence.  It  is  entirely 
feasible,  too,  to  use  women  in  interviewing  men  in  offices  and 
even  in  the  streets.  As  a  matter  of  fact,  there  are  circumstances 
in  which  a  woman  might  get  an  interview  from  a  man  who  would 
flatly  refuse  any  male  interviewer. 

On  the  other  hand,  there  are  occasions  in  which  it  is  preferable 
to  use  men;  in  some  cases  it  is  almost  essential;  as,  for  example, 
where  the  interviews  must  be  held  in  garages  or  in  notoriously 
rough  neighborhoods,  or  where  men  consumers  are  to  be  inter- 
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viewed  on  problems  with  which  they  are  particularly  acquainted- 
such  as  shaving  soaps,  pipes,  fishing  tackle. 

Dealer  interviews — with  grocery  stores,  drug  stores,  depart- 
ment stores — may  be  made  by  either  sex.  Technical  subjects 
are  usually  handled  better  by  men,  who  presumably,  at  least, 
have  some  basic  understanding  of  the  subject  matter—com- 
parable to  that  which  favors  the  woman  in  her  contact  with  the 
housewife.  Interviews  with  major  executives  may  be  handled 
almost  equally  well  by  either  men  or  women,  although,  given 
equal  qualifications,  the  man  would  probably  be  chosen  for  such 
work.  The  selection  in  such  cases  sometimes  requires  nice 
judgment,  because  there  is  reason  to  believe  that  under  some 
circumstances  a  woman  interviewer  may  get  a  better  audience 
and  a  more  detailed  interview  from  a  major  executive  than  could 
a  man.  Interviews  with  such  people  as  truck  drivers,  taxi 
drivers  and  filling-station  men  are  generally  assigned  to  men, 
chiefly  because  of  their  greater  ease  in  making  contact. 

training  of  field  personnel.  The  technique  of  training  the 
field  personnel  may  be  either  general  or  specific.  General,  if  the 
persons  to  be  trained  have  had  no  previous  experience  with 
research  interviewing;  and  specific  if  interviewers,  already  trained, 
are  being  instructed  for  a  particular  assignment.  The  following 
are  some  of  the  fundamentals  which  might  be  regarded  as  repre- 
sentative of  "general"  training: 

1.  As  to  the  Interviewer's  Own  Attitude.  He  should  be  pleasant, 
assured  and  conversational;  but  he  should  be  thoroughly  busi- 
nesslike. He  should  realize  that  he  is  taking  up  the  respondent's 
time,  distracting  him  or  her  from  other  and  probably  closer 
interests,  for  which  imposition  he  is  offering  no  compensation. 
On  the  other  hand,  he  should  realize  also  how  readily  the  average 
person  responds  to  the  proper  approach— tactful,  persuasive  and 
politely  insistent.  The  interviewer,  therefore,  should  be  pre- 
pared to  show  an  agreeable  and  genuine  interest  in  the  respond- 
ent's personality,  in  any  problems  he  may  wish  to  discuss,  in  the 
information  he  may  give  and  in  his  opinions;  he  must  have  an 
unswerving  determination  to  get  during  each  call  a  complete, 
true  and  conclusive  reply  to  every  question  on  the  schedule. 
2.  As  to  the  Attitude  to  Be  Impressed  upon  the  Respondent  For 
satisfactory  results,  the  interview  must  be  felicitous.  The 
respondent  must  be  made  to  feel  that  there  is  a  constructive  and 
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worthy  purpose  behind  the  work;  that  the  questions  are  not 
prompted  by  idle  curiosity;  that  in  some  way,  however  remote, 
he  or  his  business  or  his  community  is  likely  to  benefit  by  his 
cooperation;  that  no  publicity  will  be  given  him  or  his  answers; 
that  there  is  no  advertising  scheme  involved  and  that  there  will 
be  no  follow-up  that  could  by  any  chance  annoy  or  embarrass 
him.  The  more  fully  the  respondent  believes  the  interview  to 
be  an  integral  part  of  a  broad  study,  the  more  likely  he  is  to 
respond. 

3.  As  to  What  Constitutes  an  Adequate  Reply.  The  reply  must 
be  true.  The  interviewer  should  be  taught  to  realize  that  the 
immediate  reply  to  a  direct  question  may  not  be  the  accurate 
one.  Whether  it  is  or  not,  in  each  case,  cannot  always  be  deter- 
mined, but  where  any  qualifying  or  elaborating  statement  or 
other  conversation  in  the  course  of  the  interview  tends  to  alter 
the  meaning  or  implication  of  a  reply — that  reply  can  no  longer 
be  regarded  as  adequate.     As  it  stands,  it  is  not  true. 

To  illustrate:  On  the  questionnaire  reproduced  in  Chap.  IX — 
on  coffee,  vacuum-packed  in  glass  (page  173),  the  second  question 
of  Section  A  is,  "Is  the  manner  in  which  coffee  is  packed  of 
importance  to  you?"  This  question  was  purposely  put  in  this 
manner  to  draw  the  respondent  into  a  full  discussion  of  the 
package  factor.  In  many  instances  the  immediate  answer  to 
this  question  was  a  simple  "No";  yet,  as  the  interviews  pro- 
ceeded, it  was  brought  out  that  while  the  respondent  was  herself 
using  bulk  coffee,  professedly  for  reasons  of  economy,  she  actually 
believed  that  vacuum-packed  coffee  came  to  her  in  a  better  and 
more  desirable  condition.  In  many  other  cases,  the  respondent 
was  clearly  aware  that  the  resealing  of  coffee  in  a  glass  jar  keeps 
it  in  better  condition,  and  for  that  reason  she  had  at  some  time 
purposely  bought  coffee  in  glass  in  order  that  she  might  have  the 
container  to  keep  sealed  the  cheaper  coffee  she  purchased  in 
bulk. 

From  these  examples  it  is  obvious  that  the  manner  in  which 
coffee  is  packed  was  indeed  important  to  many  of  the  respondents 
and  that  they  had  very  definite  ideas  on  the  subject.  If,  there- 
fore, the  interviewers  had  reported  only  the  immediate  answer, 
"No,"  they  would  have  been  wholly  erroneous  and  the  entire 
study  would  have  been  distorted  and  misleading.  Contradic- 
tions of  this  sort  suggest  several  precautions: 
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a.  The  interviewer  should  allow  the  respondent  some  reason- 
able latitude,  even  to  the  point  of  wandering  into  apparently 
unrelated  fields.  This  affords  the  respondent  the  opportunity 
to  reflect  further  light  on  answers  already  given  as  well  as  on 
those  yet  to  come. 

b.  The  interviewer  should  be  taught  to  recognize  instances  in 
which  direct  and  unequivocal  replies  may  represent  only  part  of 
the  truth;  to  be  on  the  alert  for  such  weaknesses;  and  to  perceive 
in  the  respondent's  generalizations  any  significant  or  suggestive 
statement  that  might  affect  the  fullness  or  integrity  of  his 
replies. 

c.  Interviewers  should  be  taught  that  where  clarity  and  truth 
require  it  they  should  alter  an  obviously  incorrect  reply  to  con- 
form with  the  respondent's  general  disclosures. 

d.  Interviewers  who  lack  the  experience,  the  judgment  or  the 
courage  to  make  necessary  adjustments  should  be  taught  to 
include  in  their  reports  sufficient  details  to  enable  the  research 
director  to  interpret  any  questionable  reply  in  the  light  of  all 
obtainable  information. 

e.  The  interviewer  should  be  taught  that  " adequate  reply" 
means  a  full  reply— as  well  as  a  true  one.  No  point  of  informa- 
tion and  no  clear  observation,  directly  or  indirectly  related  to  the 
subject,  should  be  omitted  from  the  report.  Although  it  may 
seem  to  the  interviewer  that  the  comments  and  volunteered 
information,  over  and  above  the  actual  requirements  of  the 
question,  are  irrelevant,  they  may  contribute  enormously  to  the 
correct  understanding  of  the  situation  and  to  the  interpretation 
of  the  completed  study.  Interviewers  should  bring  in  everything 
bearing  on  the  subject,  on  the  theory  that  the  research  director 
himself  is  best  qualified  to  eliminate  such  material  as  he  may 
judge  unimportant  and  that  he  should  be  exposed  to  no  risk  of 
missing  any  vitally  significant  side  light. 

4.  As  to  Avoiding  Bias.  Bias  is  strictly  and  always  to  be 
avoided.  Interviewers  should  be  warned  carefully  and  explicitly 
and  continuously  against  allowing  their  own  convictions  to 
prompt  or  influence  the  respondent  in  the  form  or  content  of  his 
answers.  Interviewers  should  realize  that  no  information  can 
have  any  value  unless  it  be  utterly  honest.  The  interviewer 
should  approach  his  work  with  the  idea  that  he  has  no  point  to 
prove,  ano  ax  to  grind,"  no  position  to  maintain;  that  he  is  serv- 
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ing  only  as  a  medium  through  which  information  is  passing  and 
that  he  must  in  conscience  transmit  that  information  precisely 
as  he  receives  it.  The  reports  should  show  not  the  slightest 
reflection  of  the  interviewer's  own  beliefs  or  prejudices.  Con- 
sciously and  deliberately  to  give  bias  is  an  unforgivable  breach 
of  faith. 

5.  As  to  the  Use  of  Terms.  Interviewers  should  be  given  a 
clear  understanding  of  the  terminology  in  current  use  with  the 
research  organization  employing  them.  They  should  know,  for 
instance,  what  their  own  employer  means  by  supervision,  inspec- 
tion, editing,  authentication,  cross  section,  average — if  used  in 
any  other  than  the  arithmetical  sense;  how  their  own  employer 
classifies  incomes  and  rates  the  various  levels  of  rentals.  Besides, 
to  simplify  editing  and  tabulation,  the  interviewers  should  be 
given  some  idea  as  to  how  their  work  is  to  be  organized. 

" Specific"  training  of  the  field  staff  assumes,  of  course,  that 
each  member  thoroughly  understands  the  foregoing  funda- 
mentals. What  remains  now  is  to  give  the  members  of  the  staff 
such  information  and  such  instructions  as  they  may  need  for 
the  specific  job  in  hand.  Where  this  training,  whether  imparted 
verbally  or  in  writing,  can  be  augmented  by  participation  in 
some  of  the  preliminary  testing,  the  situation  is  ideal.  This 
would  give  the  research  director  an  opportunity  to  review  the 
work  of  each  member  of  the  staff  and  would  enable  him  to  cor- 
rect, suggest  and  recommend  improvements  before  proceeding 
on  the  main  body  of  the  job. 

If  the  interviews  are  to  be  obtained  by  a  group  of  reporters 
sent  out  from  the  office  in  which  the  plans  have  originated, 
specific  training  could  be  given  them  in  person.  If,  however,  as 
is  sometimes  the  case,  a  supervisor  from  the  central  office  organ- 
izes scattered  local  groups  of  interviewers,  the  training  would 
necessarily  take  the  form  of  explicit  written  instructions.  In 
this  latter  instance,  the  home  office  regards  the  supervisor  as  its 
representative,  directly  accountable  for  the  success  of  the  field 
work,  and  he  should,  of  course,  have  adequate  experience,  equip- 
ment and  training  to  warrant  that  responsibility. 

A  great  many  surveys  are  now  handled  through  the  use  of 
resident  investigators  living  in  various  parts  of  the  country  and 
working  under  written  instructions  from  a  central  office.  Obvi- 
ously, under  such  conditions,  it  is  necessary  to  acquaint  these 
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interviewers  more  fully  with  the  background  of  the  study  and  to 
instruct  them  with  greater  care  than  would  be  necessary  with 
those  working  in  direct  contact  with  the  main  office. 

Specific  training,  however  imparted,  should,  of  course,  include 
the  following: 

1.  A  General  Outline  of  the  Study.  This  seems  necessary  to 
enable  the  interviewer  to  proceed  with  an  intelligent  regard  for 
the  work  and  its  purpose.  Too  intimate  a  knowledge  of  the 
study,  however,  is  generally  to  be  avoided.  The  interviewer 
may  safely  be  told,  for  instance,  that  the  survey  concerns  coffee — 
but  the  study  may  suffer  if  he  knows  which  one  of  the  many 
brands  of  coffee  is  being  surveyed.  In  outlining  the  study, 
therefore,  considerable  judgment  is  required  in  giving  the  inter- 
viewer all  the  information  he  needs  for  effective  work  and  in 
withholding  from  him  everything  that  might  impair  the  complete 
detachment  an  interviewer  should  have. 

On  the  other  hand,  keeping  the  interviewer  in  ignorance  of  the 
full  purpose  of  the  study  may  sometimes  result  in  a  disadvantage. 
As  a  trained  observer,  the  experienced  interviewer  is  constantly 
absorbing  impressions  in  the  field  and,  if  he  knows  enough  of 
the  study  to  evaluate  and  report  these  impressions,  they  may  be 
found  of  great  value  in  interpreting  the  results. 

In  seeking  these  casual  impressions,  however,  it  is  well  to  con- 
sider the  extent  to  which  the  integrity  of  the  study  may  be  endan- 
gered by  the  interviewer's  too  comprehensive  knowledge  of  the 
study. 

2.  Upon  Whom  the  Calls  Are  to  Be  Made.  Under  this  heading 
the  general  plan  of  field  procedure  should  be  explained.  The 
interviewer  is  instructed  to  call  on  every  fifteenth  family,  in 
every  street,  in  the  district  assigned  to  him;  or  on  the  drug  or 
grocery  store  nearest  every  third  corner  throughout  his  district; 
or  whatever  the  field  work  is  to  be.  Further,  if  calls  are  to  be 
made  on  homes,  the  interviewer  should  be  told  precisely  whom 
he  is  to  interview.  If  this  is  not  made  clear,  some  interviewers 
will  inevitably  take  their  responses  from  minors  and  even  from 
servants.  Generally  speaking,  it  is  the  housewife  whose  experi- 
ences or  reactions  are  required.  It  should  be  explained,  there- 
fore, that  if  the  housewife  herself  is  not  accessible,  the  reporter 
must  be  sure  that  the  person  interviewed  is  of  sufficient  credibility 
to  give  value  to  his  or  her  knowledge  of  the  situation. 
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3.  How  the  Interviewers  Are  to  Conduct  Themselves.  Under 
this  heading  the  interviewer  should  be  told  how  to  approach, 
present  and  close  the  typical  interview.  Perhaps,  even,  a  few 
words  of  introduction  should  be  prepared  for  him,  so  that  he  may 
waste  no  time  and  create  no  false  or  unfavorable  impression  in 
improvising  his  own  introduction. 

The  interviewer  should  be  enlightened  on  a  number  of  other 
points  as  well.     For  instance: 

a.  Is  the  questionnaire  to  be  used  openly  in  the  presence  of 
respondents?  This  is  determined  usually  by  the  nature  of  the 
study,  the  length  of  the  questionnaire,  the  type  of  people  to  be 
addressed,  the  circumstances  under  which  the  questions  must  be 
asked  and  other  similar  considerations. 

It  is  difficult  to  see,  for  instance,  how  the  result  can  be  affected 
one  way  or  another  by  referring  to  and  filling  out  a  simple  cate- 
gorical questionnaire  in  the  presence  of  the  respondent;  but  if 
the  subject  matter  of  the  survey  should  be  abstract  in  charac- 
ter, dealing  with  impulses  or  reasoned  motives  or  considered 
opinions,  the  open  use  of  the  questionnaire  might,  as  a  distrac- 
tion, affect  the  respondent's  judgment. 

The  length  of  the  questionnaire  is  subject  to  similar  considera- 
tions. In  the  open  handling  of  a  short  schedule  the  interview 
would  probably  end  before  the  respondent  could  be  very  greatly 
affected;  further,  a  short  schedule  can  be  memorized  readily  and 
in  full  so  that  the  replies  would  probably  be  reliable,  whether  the 
questionnaire  were  shown  or  not.  But  a  long  questionnaire  may 
disturb  the  respondent  considerably.  Its  open  use  might  hurry 
his  replies,  distort  his  judgment  and  might  even  lead  him  into 
deliberate  misrepresentation  for  the  sake  of  conserving  time. 
Such  a  schedule  presents  a  real  problem  because  it  is  difficult  for 
an  interviewer  to  memorize,  with  certainty,  any  long  or  complex 
list  of  questions;  and  in  some  degree  it  is  hazardous  not  to  do  so. 
In  such  situations  probably  the  safest  course  is  for  the  inter- 
viewer to  memorize  the  high  lights  of  his  questionnaire.  Then, 
tactfully,  he  can  weave  his  questions  into  the  general  conversation 
and  jot  down  the  answers  as  briefly  as  possible  in  a  note  book  or 
even  on  a  casual  sheet  of  paper.  In  such  instances,  however,  the 
reporter  should  work  his  notes  into  a  complete  and  formal  report 
immediately  upon  leaving  the  respondent;  and  in  no  case  should 
he  conduct  a  second  interview  before  having  completed  the  first. 
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The  type  of  people  to  be  addressed  affects  the  open  use  of  the 
questionnaire  in  that,  quite  obviously,  some  persons  resent  close 
questioning  on  any  point.  They  just  cannot  gracefully  surrender 
themselves  to  a  critical  examination.  For  this  reason  it  is  prob- 
ably safest  for  the  interviewer,  in  all  cases,  to  memorize  at  least 
the  first  two  or  three  questions.  This  launches  him  well  into 
the  interview  and  enables  him  to  determine,  with  fair  judgment, 
whether  or  not  he  can  safely  bring  his  questionnaire  out  into  the 
open. 

The  circumstances  under  which  the  questions  must  be  asked 
also  affect  the  open  use  of  the  questionnaire.  There  are,  indeed, 
conditions  under  which  direct  reference  to  the  schedule  is  impos- 
sible. As  an  example :  In  a  survey  having  to  do  with  newsstand 
purchases  of  magazines,  where  the  respondent  must  be  caught 
between  the  moment  of  purchase  and  his  flight  into  a  contiguous 
subway  or  elevated  station,  there  would  be  no  time  for  the  use 
of  a  questionnaire.  Whatever  four  or  five  questions  are  to  be 
addressed  must  be  shot  at  the  respondent  on  the  run. 

The  criterion  on  which  all  questions  of  this  type  should  be 
determined  is  whether  or  not  one  method  is  more  likely  to  develop 
the  truth  than  another  and  which  method  is  exposed  to  the  lesser 
chance  of  error.  Each  case  must,  therefore,  be  considered  in  the 
light  of  its  own  peculiar  features. 

b.  Is  the  interviewer  to  make  observations  aside  from  the  ques- 
tionnaire? If  he  is,  he  must  be  provided  with  a  very  concise 
statement  of  the  matters  he  is  to  observe  and  suitable  guides  must 
be  set  up  for  his  judgment.  To  illustrate:  In  a  certain  study  of 
newspaper  readership  it  was  necessary  to  confirm  or  refute  the 
claims  of  one  of  the  other  local  papers  that  it  alone  served  all  of 
the  "educated,"  "clean,"  "thrifty,"  "intelligent"  and  "responsi- 
ble" readers  of  that  city.  This  was  a  foolish  claim  but  it  was 
being  skillfully  exploited  by  published  implications  and  innuendoes 
and  was  confusing  the  minds  of  space  buyers  as  to  the  best 
medium  in  that  market. 

In  conducting  the  field  work  on  this  study,  therefore,  each 
interviewer  was  asked  to  observe  and  note  on  each  call  just  how 
the  person  interviewed  impressed  him  with  respect  to  the  several 
personal  attributes  claimed  by  the  one  paper  to  distinguish  its 
readers  exclusively.     None  of  the  interviewers  was  aware  of  these 


160  THE  TECHNIQUE  OF  MARKETING  RESEARCH 

claims  and  none  was  given  any  idea  of  the  reasons  underlying  the 
required  observations. 

To  procure  the  highest  possible  degree  of  uniformity  in  these 
observations  each  of  the  attributes  was  defined  briefly  in  some- 
what this  manner: 

"Educated."  We  mean  education  merely  in  its  colloquial  sense  and  not 
in  any  academic  or  technical  sense.  If,  by  her  conversation,  her  use  of 
words  and  grammar,  the  person  impresses  you  as  being  moderately  educated, 
it  is  sufficient. 

"Clean."  We  mean  to  take  into  consideration  the  time  of  the  day  and 
any  other  circumstances  which  might  affect  the  point.  ,The  point  is,  "Do 
you  get  the  impression  of  personal  and  domestic  cleanliness — reasonably 
construed?" 

"Thrifty."  We  mean,  does  the  person  impress  you  as  one  interested  in 
making  a  dollar  go  as  far  as  possible?  Does  her  conversation  indicate  that 
she  is  interested  in  values  and  prices,  and  does  she  watch  advertisements  for 
bargains? 

"Intelligent."  We  mean,  does  the  person  readily  grasp  your  questions, 
and  do  her  responses  indicate  a  reasonable  comprehension  of  your  purpose? 

"Orderly."  We  mean,  does  the  general  aspect  of  so  much  of  the  place  as 
you  can  see  impress  you  as  being  reasonably  ordered  or  as  slovenly? 

"Obviously  able  to  buy  normal  needs."  We  mean — district,  race,  environ- 
ment considered — do  you  get  the  impression  that  the  family  is  able  to  pro- 
vide itself  with  its  reasonable  requirements  in  the  way  of  food,  clothing, 
conveniences,  etc.?  The  conveniences  already  possessed  and  the  general 
atmosphere  of  the  home  are  fair  indications  on  this  point. 

Remembering  that  these  observations  had  a  purpose  and  were 
more  or  less  forced  into  this  study  by  the  peculiar  claims  of  one 
of  the  papers,  the  final  report  on  the  study  contains  this  note: 

These  "impressions"  are  generalities  only.  Unless  the  terms  could 
be  defined  with  precision  and  applied  under  conditions  strictly  controlled, 
they  could  not  be  regarded  as  scientific  in  any  sense.  But,  since  they 
represent  the  reactions  of  a  group  of  intelligent  and  purposeful  observers, 
drawn  from  a  ten-  to  fifteen-minute  conversation  with  a  large  number 
of  persons — at  their  homes  and  under  circumstances  which  make  obser- 
vation easy — they  have  an  indicative  value  which  is  sufficiently  prac- 
tical to  justify  their  presentation  here. 

The  results  in  this  case  indicated  that,  however  incomplete  these 
definitions  might  seem,  they  did  maintain  approximately  uniform 
standards;  having  been  applied  indiscriminately  to  all  the  exclu- 
sive readers  of  all  the  papers  in  that  city  they  worked  no  injustice 
oh  any  of  them;  and  they  had  the  practical  effect  of  controverting 
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beyond   cavil   the   unusual   implications   of   the   too-optimistic 
publication. 

c.  The  significance  of  each  question  should  be  thoroughly 
explained.  As  stated  elsewhere  this  should  be  done  without 
revealing  too  much  of  the  purpose  of  the  study.  The  point  here 
is  to  make  sure  that  each  interviewer  has  a  sufficient  grasp  of 
the  work  as  a  whole  and  of  each  question  in  particular  to  recognize 
whether  or  not  the  answer  in  each  case  is  adequate.  At  the  same 
time,  the  interviewer's  attention  can  be  drawn  to  those  questions 
on  which  a  categorical  answer  may  require  elaboration  in  the 
interest  of  fullness  and  truth. 

d.  The  interviewer  should  understand  that  his  work  is  being 
conducted  under  supervision  and  under  inspection— if  that  be 
the  case.  The  thought  is  that  the  interviewer  will  feel  more 
keenly  his  responsibility  for  competent  work,  if  he  realizes :  That 
his  work  is  to  be  compared  with  that  of  many  other  people — that 
it  is  to  be  combined  with  the  similar  work  of  others — that  incor- 
rect or  slovenly  work  will  be  promptly  exposed  and  that  any  care- 
lessness on  his  part  may  invalidate  and  make  useless  the  work  of 
all  the  other  investigators. 

e.  Finally,  the  requirement  of  truth  should  again  be  stressed. 
While  this  point  has  been  referred  to  under  general  training,  the 
importance  of  a  true  and  full  answer  to  every  question  should  be 
emphasised  in  connection  with  every  research  project.  And  some 
words  of  warning  against  "bias"  are  always  in  order. 

These  are  some  of  the  subjects  on  which  specific  training  should 
be  given  to  the  field  worker.  Since  it  is  often  difficult  to  include 
all  the  essentials  in  prepared  instructions  for  interviewers,  par- 
ticularly for  those  representatives  who  are  to  work  at  a  distance, 
some  sample  instruction  sheets  are  shown  in  the  following 
chapter. 


CHAPTER  IX 
ORGANIZATION  OF  FIELD  WORK 

(Elaboration  of  Chart  F,  page  108,  Continued) 

A  large  marketing  research  operation  requires  reporters,  super- 
visors, inspectors,  editors  and  tabulators.  Each  group  has  its 
own  function  and  technique.  Quite  obviously  a  well  denned 
routine  is  involved  in  coordinating  the  work  of  these  several 
groups  to  the  end  that  each  will  perform  its  function  in  harmony 
with  all  the  others  and  that  the  work  will  proceed  with  the 
minimum  of  friction  and  waste. 

Organization  (Continued).  The  distinctions  which  have  been 
drawn  in  connection  with  the  other  phases  of  research  work — 
between  studies  made  by  direct  investigation,  by  telephone,  by 
mail  and  by  personal  interviews — obtain  also  with  respect  to 
routine.  Wherever  work  is  to  be  performed  by  groups  of  persons 
scattered  over  a  wide  field,  some  definite  routine  is  imperative, 
but  the  extent  of  that  routine  varies  with  the  degree  of  control 
necessary  under  any  given  circumstances. 

routine  for  conducting  study.  In  a  study  made  by  "  direct 
investigation"  of  records,  under  the  research  director  himself, 
there  would  be  little  need  for  routine.  In  a  study  made  by 
"mailed  questionnaires,"  aside  from  the  mechanical  work  of 
mailing,  the  only  routine  required  would  concern  the  tabulating 
organization.  In  a  study  made  by  "telephone  inquiries,"  a 
little  more  routine  is  required;  there  are  involved  a  time  element, 
as  to  when  calls  are  to  be  made;  a  class  element,  as  to  whom  to 
call  and  an  organization  element,  as  to  which  operator  is  to  cover 
each  district. 

In  a  study  made  by  "multiple  personal  interviews,"  a  still  more 
elaborate  routine  is  required  and  this  type  of  study  embraces 
practically  all  the  features  of  routine  involved  in  any  of  the  other 
types. 

The  first  element  of  routine  with  respect  to  interviewers  governs 
where  each  reporter  is  to  work.  The  purpose  of  the  study  deter- 
mines how  this  distribution  of  work  shall  be  accomplished.     For 
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example :  if  reflections  from  a  number  of  retail  druggists  or  grocers 
are  required  and  it  is  desired  at  the  same  time  to  avoid  any- 
improper  selection  of  the  stores,  the  market  might  be  divided 
into  districts  and  each  reporter  directed  to  proceed  along  each 
street  within  his  assigned  district,  calling  on  every  store  or  every 
second,  third  or  fourth  store,  irrespective  of  its  size  or  quality. 

A  survey  of  that  type  would  cover  the  entire  market,  reaching 
into  every  district  and  would  in  all  probability  touch  all  the 
various  classes  of  dealers  in  approximately  the  ratio  each  class 
bears  to  the  market  as  a  whole. 

Under  other  circumstances  the  reporters  might  be  relieved  of 
the  responsibility  of  selecting  their  own  calls.  Each  reporter 
can  be  given  a  map  definitely  marking  out  his  route  and  even 
designating  the  stores  or  houses  necessary  to  provide  a  cross 
section  of  as  much  of  the  market  as  it  is  desired  to  cover. 

In  a  study  requiring  a  canvass  of  a  Media  trading  area,  in  order 
to  determine,  for  example,  the  type  of  people  reached  by  a  certain 
newspaper,  it  would  be  necessary  to  spread  the  inquiries  into 
every  neighborhood.  And  those  inquiries  would  have  to  be 
distributed  in  such  a  manner  as  to  reflect  the  situation  in  every 
income  group,  in  every  socially  distinctive  section  within  the 
area  and  in  every  other  significant  subdivision — as  determined 
by  race,  occupation,  sex,  age— in  as  nearly  as  possible  the  ratio 
those  groups  bear  to  the  whole  population. 

To  assure  an  absolutely  dependable  coverage  of  the  city,  the 
routine  for  such  a  study  would  quite  clearly  have  to  follow  some 
fixed  pattern.  In  such  a  case  a  map  of  the  city  might  be  cut  up 
in  conformity  with  the  districts  allotted  to  the  several  reporters; 
they  might  be  instructed  to  interview  every  tenth  family  on 
every  street  within  such  assigned  district,  irrespective  of  the  size 
or  character  of  the  home  or  of  the  color,  character  or  condition 
of  its  occupants.  The  routine  might  even  require  each  reporter, 
immediately  after  each  call,  to  mark  upon  his  section  of  the  map 
the  approximate  position  of  the  interview,  so  that,  at  a  glance,  the 
research  director  can  determine  that  the  interviews  are  being 
spread  fairly  evenly  over  the  territory. 

Since  any  result  one  may  desire,  favorable  or  unfavorable,  can 
be  procured  by  an  adroit  selection  of  respondents,  every  possible 
precaution  should  be  taken  to  assure  a  thoroughly  dependable 
cross  section  of  any  area  or  class  of  persons  being  surveyed. 
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The  next  item  of  routine  for  a  field  staff  is  to  designate  the 
time  they  are  to  work.  This  is  determined  by  several  factors, 
which  grow  out  of  the  nature  of  the  study.  If  merchants  are  to 
be  interviewed  it  is  necessary  to  ascertain  at  what  hours  of  the 
day  they  are  likely  to  be  most  accessible,  because  in  some  types 
of  stores  there  are  peaks  of  activity  during  which  no  dealer  should 
be  expected  to  answer  questions.  If  housewives  are  to  be  called 
upon  it  is  necessary  to  know  just  what  hours  would  be  most  con- 
venient for  them;  and  different  hours  might  be  indicated  for 
different  sections  of  the  city;  an  elite  section,  for  example,  may 
require  that  calls  begin  at  a  somewhat  later  hour  than  an  average 
residential  area.  Interviews  with  businessmen  in  offices,  or 
interviews  with  husbands  and  wives,  together  or  in  company 
with  adolescents,  necessarily  are  limited  as  to  the  time  of  the 
interview  and  in  some  instances  may  even  require  evening 
calls. 

In  some  degree  this  element  of  time  enters  most  surveys  and 
frequently  assumes  great  importance.  For  instance,  if  a  study 
were  being  made  of  the  newsstand  sales  of  daily  papers  it  would 
do  little  good  to  begin  at  nine  o'clock  in  the  morning  on  the 
stands  in  residential  neighborhoods;  for  such  stands  the  heavy 
selling  of  the  morning  papers  is  then  over — seven  o'clock  might 
be  the  proper  time.  Similarly,  one  could  not  stop  working  on 
the  downtown  stands  as  early  as  five  o'clock;  the  heaviest  selling 
of  the  evening  papers  has  not  yet  begun — from  five  to  seven 
o'clock  might  be  the  best  time  for  such  a  study.  It  is  clearly 
necessary,  therefore,  to  know  the  best  time  for  the  specific  work 
in  hand  and  to  route  the  staff  accordingly. 

The  next  natural  point  of  routine  is  to  determine  how  the 
field  staff  shall  do  the  mechanical  part  of  the  job.  Are  they  to 
ride  or  walk;  are  they  to  use  pencil  or  ink;  are  they  to  report  to 
supervisors  or  to  a  central  office;  are  they  to  turn  in  their  work 
daily  or  when  finished,  in  person  or  by  mail,  in  the  evening  or 
the  morning?  These,  and  other  similar  provisions,  are  usually 
covered  in  the  instructions  in  each  case. 

Next  to  the  questionnaire,  the  instruction  sheet  is  probably 
the  most  important  form  used  in  surveys  of  substantial  propor- 
tions. Common  sense  and  the  needs  in  each  case  determine  the 
extent  and  kind  of  instructions  to  be  issued  to  the  various  mem- 
bers of  the  staff.     Probably,  the  most  comprehensive  idea  of 
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routine  can  be  derived  from  a  review  of  the  actual  forms  which 
follow. 

In  the  case  shown  first,  the  field  staff  was  recruited  specifically 
for  a  newspaper  study.  Counting  interviewers,  supervisors  and 
inspectors,  there  were  about  thirty  in  the  organization.  They 
were  given  a  full  day  of  intensive  instructions  by  the  research 
director  in  person.  Every  point  was  covered;  every  question 
that  arose  in  the  mind  of  any  member  of  the  group  was  answered 
with  ample  elaboration  for  the  benefit  of  all.  Then,  as  an  addi- 
tional feature,  a  multigraphed  digest  of  the  day's  instructions  was 
given  to  each  member  of  the  staff  as  a  reminder  of  the  routine 
and  for  reference  on  any  doubtful  point  that  might  arise  in  the 
field.  For  the  purpose  of  this  illustration  the  questionnaire  is 
first  shown  (Fig.  16)  and  then  followed  by  the  resume  referred  to. 

COPY  OF  INSTRUCTIONS  TO  FIELD  STAFF 

To  all  field  workers,  supervisors  and  inspectors: 

This  is  a  digest  of  the  matters  presented  to  you  orally  in  connection  with 
the  study  you  are  about  to  begin.  It  is  being  given  to  you  in  this  form  as  a 
reminder  of  each  item  and  as  a  guide  to  you  in  your  work  in  the  field. 

1.  There  is  no  publicity  connected  with  any  phase  of  this  work;  it  is  not 
to  be  followed  by  any  literature  from  any  manufacturer  and  there  is  posi- 
tively no  selling  scheme  involved.  It  is  pure  study.  (It  was  to  set  the 
respondents  at  ease  on  these  points  that  no  names  were  called  for  on  the 
questionnaire.     Names  were  not  necessary  in  this  study.) 

2.  You  are  to  call  on  every  eighth  house  on  every  street  in  the  district 
assigned  to  you.  In  an  apartment  house  you  will  follow  the  same  rule, 
calling  on  every  eighth  apartment.  The  idea  of  this  is  to  avoid  any  hand- 
picking  of  the  people  interviewed. 

If  it  should  happen  that  the  eighth  house  is  closed  for  the  summer  or 
inaccessible  for  any  reason  you  can  substitute  the  seventh  house  or  take  the 
ninth  house  instead;  but  in  such  an  event,  begin  your  new  count  from  the 
house  that  was  properly  the  eighth. 

3.  You  are  to  ask  for  the  lady  of  the  house  and  try  hard  to  see  her — on 
the  theory  that  she  is  the  one  best  qualified  to  answer  your  questions.  In 
the  majority  of  cases  it  is  not  difficult  to  procure  an  interview,  but  it  is 
inevitable  that  you  will  find  a  few  persons  who  may  refuse  to  discuss  the 
subject  with  you.  With  these  you  will  have  to  work  a  bit  harder  to  get 
their  interest.  This  is  a  sort  of  selling  operation.  Try  to  make  the  respon- 
dent understand  that  this  whole  movement  is  for  a  study  purpose;  that  it 
is  important  for  you  to  complete  the  work;  that  her  help  is  extremely  neces- 
sary to  the  success  of  your  efforts;  that  it  will  take  no  more  than  a  moment; 
that  it  entails  no  effort  on  her  part  aside  from  answering  a  few  simple 
questions;  and  make  it  perfectly  clear  that  there  is  nothing  to  be  sold  and  no 
follow-up  to  be  made  that  might  annoy  her. 


ORGANIZATION  OF  FIELD  WORK  167 

This  is  where  the  real  test  of  research  work  comes  in.  It  takes  tact, 
personality  and  persistence  in  these  minority  cases.  But  very  frequently 
it  is  the  reaction  of  this  minority  which  is  most  important  and  for  that 
reason  it  will  be  necessary  for  you  to  use  all  your  arts  and  every  possible 
effort  to  make  her  answer  the  questions — all  of  them. 

4.  Approach.  There  is  no  use  in  giving  you  the  precise  words  to  use  in 
introducing  yourself  or  your  mission.  Each  interviewer  will  express  him  or 
herself  in  the  natural  and  instinctive  manner.  Don't  "fire"  your  questions 
at  your  people  like  so  many  explosives;  don't  create  the  impression  that 
you  are  a  prosecuting  attorney.  A  pleasant,  confident,  assured  and  con- 
versational attitude  will  prove  more  effective.  You  are  doing  a  perfectly 
legitimate  work,  the  benefit  of  which  will  reflect  on  your  city;  because  on 
the  strength  of  this  study  we  hope  more  money  will  be  spent  for  advertising 
in  your  local  papers.  You  can,  therefore,  approach  these  interviews  with 
the  feeling  of  having  a  useful  and  proper  purpose  to  perform. 

Should  it  prove  impossible  to  interview  the  lady  of  the  house,  find  out  if 
there  is  an  adult  daughter  or  other  member  of  the  household  of  sufficient 
credibility  to  give  value  to  his  or  her  knowledge  of  the  situation.  In  which 
case,  you  may  interview  such  other  persons,  but  confine  yourself  to  wives, 
husbands,  adult  daughters  and  adult  sons,  if  possible;  in  the  absence  of  any 
of  these,  you  may  interview  either  a  mother,  mother-in-law,  adult  sister  or 
sister-in-law,  or  other  such  relative  who  might  be  regarded  as  credible.  Do 
not,  however,  interview  any  one  of  doubtful  responsibility;  that  is  to  say, 
we  could  not  rely  upon  the  reactions  of  an  ordinary  housemaid  or  of  a  person 
manifestly  senile. 

5.  Opening.  This  has  reference  to  your  first  few  words  with  your 
prospect.  You  must  remember,  of  course,  that  you  are  doing  this  work 
solely  for  study  purposes.  It  would  seem  legitimate  to  say,  for  instance, 
that  you  are  connected  with  the  public  school  system,  as  you  are;  that  you 
are  one  of  a  group  making  a  disinterested  study  of  newspaper  conditions  and 
influence;  that  it  is  a  purely  scientific  work  you  are  doing  in  connection  with 
a  research  organization  in  New  York;  that  similar  studies  are  being  con- 
ducted elsewhere  through  student  bodies  and  local  school  organizations  for 
the  purpose  of  establishing  certain  definite  facts  regarding  the  influence  of 
newspapers  in  the  home. 

Try,  however,  to  take  as  little  time  as  possible  in  the  introductory  period 
because  you  will  not  want  the  respondent  to  become  restive  during  your 
interrogation. 

6.  Interrogation.  You  will  notice  that  the  questionnaire  (Fig.  16)  is 
divided  into  four  sections.  The  first  and  last  involve  questions  which  you 
can  answer  from  your  own  observation.  In  your  conversation  with  the 
person,  you  can  disregard  all  the  questions  in  sections,  "A"  and  "D." 

Your  first  question  is,  "Do  you  read  a  morning  paper?"  If  the  subject 
says  "Yes,"  you  may  just  "check  mark"  the  corresponding  space  and 
similarly  if  the  answer  to  your  second  question,  "Do  you  read  an  evening 
paper?"  is  affirmative.  A  "check"  will  be  construed  as  an  affirmative 
answer  to  any  of  the  categorical  questions. 
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Your  third  question  is,  "To  which  section  of  the  morning  paper  do  you 
give  attention — news,  editorials,  special  features,  advertisements?"  Since 
this  is  not  essentially  a  reader-interest  survey,  we  shall  not  go  into  all  the 
connotations  of  the  word  "attention."  The  person  interviewed  may  give 
you  an  indefinite  reply  such  as  "glances  at  the  headlines"  or  "reads  casu- 
ally," etc.  In  these  cases  ask  a  few  more  questions  in  order  to  clarify  the 
lady's  meaning  so  that  her  final  answer  may  be  definite  with  respect  to  the 
four  sections  mentioned. 

We  have  suggested  your  writing  as  little  as  possible  so  as  not  to  retard  the 
interview.  If  the  lady  answers  definitely  "Yes,"  you  can  indicate  it  with  a 
"check-mark,"  but  if  she  qualifies  her  answers,  try  to  get  enough  to  reflect 
the  situation  fully. 

Your  fourth  question  is  a  repetition  of  the  third  with  reference  to  the 
evening  paper  and  you  will  follow  the  same  procedure. 

The  fifth  question  is  perhaps  the  most  important  on  the  questionnaire, 
because  our  organization  is  endeavoring  to  measure  the  influence  of  news- 
papers with  reference  to  advertising.  That  is  to  say,  just  what  influence 
have  newspapers,  morning  or  evening,  upon  the  purchases  of  their  readers? 

In  the  space  after  each  subdivision  you  will  indicate  by  initials  whether 
it  is  the  A.  M.  Paper  or  the  P.  M.  Paper  which  most  influences  the  readers; 
and  if  she  makes  any  comments  which  you  think  might  have  value,  note 
these  comments  in  abbreviated  form.  If  you  have  any  preconceived  notion 
as  to  which  paper  influences  you  personally,  please  do  not  let  your  thought 
influence  the  person  you  are  interviewing.  It  is  her  uninfluenced  reaction 
we  are  trying  to  get  so  that  nothing  in  your  conversation  or  look  or  manner 
should  be  allowed  to  direct  her  answer. 

If  the  respondent  is  influenced  by  neither  paper,  write  in  the  word  "none." 

Your  sixth,  seventh  and  eighth  questions  are  designed  to  discover  how 
many  other  persons  in  each  household  read  and  are  affected  by  the  morning 
and  evening  papers. 

Your  ninth  and  tenth  questions  are  important  as  showing  the  difference 
between  papers  delivered  at  the  home  and  papers  bought  on  the  streets. 
But  this  refers  only  to  the  paper  read  by  the  party  being  interviewed. 
Other  members  of  the  family  may  also  buy  a  paper,  on  the  street  or  else- 
where, but  what  these  members  do  with  their  paper  has  nothing  to  do  with 
this  question. 

Very  frequently  the  morning  papers  are  delivered  at  the  home,  imme- 
diately monopolized  by  the  male  members  of  the  family  and  carried  away 
by  them  to  their  respective  places  of  business  so  that  the  lady  of  the  house 
has  very  little  opportunity  to  read  the  paper,  either  for  its  news,  editorials, 
or  advertising  influence.  We  would  like  to  know  to  what  extent  this 
situation  occurs. 

The  eleventh  question  is  related  to  the  ninth  and  tenth,  because  it  is 
designed  to  show  whether  the  P.  M.  paper  is  brought  home  for  the  evening 
or  thrown  away. 

These  questions  form  a  sort  of  checkup  on  some  of  the  earlier  questions. 
For  instance,  the  lady  may  say  that  she  reads  the  morning  paper  thoroughly 
and  later  on  she  may  say  that  her  husband  takes  the  paper  to  his  office,  in 
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which  event  there  would  appear  to  be  a  conflict  which  should  be  straightened 
out.  She  should  revise  her  first  statement,  because  obviously  she  cannot 
thoroughly  read  the  paper  and  cannot  be  influenced  by  its  advertising. 
The  questions  addressed  to  her  have  reference  only  to  the  paper  she  reads. 

In  the  event  of  any  such  conflict  in  statement  tactfully  bring  the  lady 
back  to  her  first  statement  and  see  if  that  represents  the  actual  situation  in 
the  light  of  her  admission  that  the  morning  paper  does  not  stay  at  home. 

Similarly  if  to  question  eleven  her  answer  should  be  that  her  husband 
"throws  the  evening  paper  away,"  she  would  have  no  opportunity  to  read 
it.  If  by  chance  her  earlier  answers  indicate  that  she  did  read  the  paper 
you  should  tactfully  ascertain  how  she  could  read  it  if  her  husband  throws 
it  away. 

Your  twelfth  question,  "Do  you  receive  more  than  one  copy  of  the  morn- 
ing or  evening  paper?"  The  purpose  of  this  is  to  determine  if  habitually 
more  than  one  copy  of  the  same  paper  enters  the  same  home  and  how  many 
such  homes  there  are. 

The  thirteenth  and '  fourteenth  questions  are  comparatively  simple. 
They  are  designed  to  ascertain  how  far  the  "personality"  of  either  paper 
penetrates  the  home. 

That  closes  the  list  of  general  questions  and  opens  the  third  section  of 
questions  with  number  fifteen.  This  question— "Automatic  household 
appliances  owned" — is  intended  to  reveal  the  buying  disposition  of  the  family. 
If  it  supplies  itself  with  such  conveniences  as  these,  it  is  a  fair  inference  that 
the  family  is  financially  substantial  and  worth  soliciting  through  general 
publicity. 

The  sixteenth  question  is  of  the  same  character  and  refers  to  whether  or 
not  the  respondent  owns  an  automobile  and  has  a  telephone. 

The  seventeenth  question  has  to  do  with  the  occupation  of  the  head  of  the 
house.  It  would  not,  be  tactful  to  ask  the  lady  outright  what  her  husband 
does,  but  you  might  ask  her  to  indicate  to  what  general  class  her  husband 
belongs;  and  then  read  to  her  the  fist  of  occupations,  checking  the  one  she 
designates.  Under  the  heading  "general"  put  occupations  not  otherwise 
specified — laborers,  motormen,  conductors,  janitors  and  the  like.  And  with 
unemployed  persons  put  them  in  the  class  to  which  they  would  belong  if 
employed — :that  is,  the  person  is  a  "clerk"  out  of  work,  or  a  "salesman" 
disengaged  or  an  "executive"  without  a  connection.1 

In  the  eighteenth  question  we  want  to  find  out  if  the  family  owns  the 
house,  and  this  question  is  the  last  one  to  be  asked.  It  needs  to  be  framed 
diplomatically  or  perhaps  imbedded  in  conversation,  but  get  the  informa- 
tion, as  it  is  quite  important.  This  brings  you  to  section  "D".  You 
will  notice  that  all  these  are  points  which  can  be  gotten  from  observation. 

1  The  study  in  which  these  instructions  were  used  was  made  before  unem- 
ployment became  a  national  problem.  Under  the  conditions  then  prevail- 
ing, this  method  of  classifying  the  nominal  unemployed  could  not  greatly 
affect  the  results  of  the  study.  It  would  probably  be  questionable  if  applied 
to  the  extraordinary  unemployment  circumstances  which  developed  as  a 
concomitant  of  the  latest  depression. 
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The  nineteenth  item  is  the  "type  of  house."  You  can  see  for  yourself 
whether  it  is  one  family,  two  family  or  apartment;  and  you  can  also  deter- 
mine for  yourself  the  answer  to  question  twenty  as  to  general  character  of 
residence— district  and  color  (of  residents)  considered.  You  will  come  to 
some  districts  where  practically  every  house  is  a  pretentious  one,  but  even 
here  one  or  two  may  stand  out  with  greater  prominence.  Those  should  be 
marked  "Pretentious,"  and  the  other  "Average"  or  above;  but  in  such  a 
case  please  note  at  the  bottom  of  your  card  the  fact  that  in  this  area  all  houses 
are  of  expensive  type.  Similarly  if  all  the  houses  are  squalid  they  would 
represent  the  average  for  that  district,  but  in  such  a  case  please  note  at  the 
bottom  of  the  card  that  all  the  houses  are  squalid. 

The  purpose  of  these  questions  is  to  give  us  a  more  or  less  clear  idea  of  the 
character  of  residences  in  your  district. 

To  guide  your  judgment  with  respect  to  question  twenty-one  you  will 
understand  that  by: 

[Then  followed  the  series  of  definitions  covering  the  several  personal 
characteristics  which  have  been  presented  on  page  160  in  Chap.  VIII  in 
connection  with  training  the  field  force.] 

The  second  example  of  instructions  represents  the  routine 
followed  in  connection  with  a  field  staff  operating  at  a  distance 
from  the  research  office.  It  contemplates  instructions  to  be 
imparted  through  the  mails  to  an  established  organization.  In 
these  cases  there  is  no  opportunity  for  personal  contact,  so  that 
the  instructions  must  be  specific  and  all  embracing. 

To  illustrate  this  method  the  following  forms  are  presented : 

Outline  for  Instructions  to  Field  Workers. 

(This  represents  a  sort  of  guide  or  check  list  used  by  Market  Research 
Corporation  of  America  as  an  assurance  against  the  omission  of  any  material 
feature.) 

1.  Purpose  of  the  survey. 

2.  Quota. 

Number  of  interviews  (number  of  questionnaires  to  be  done  per 
day). 

What  constitutes  a  completed  interview. 

When  interviews  are  to  be  made  (this  refers  to  interviews  to  be  made 
at  some  particular  time  of  day). 

Where  interviews  are  to  be  made  (this  applies  to  interviews  to  be 
made  in  specific  places  such  as  garages,  parking  places,  or  any 
other  definite  location). 

Whom  to  interview  (college  students,  housewives,  businessmen, 
etc.).  Where  interviews  with  housewives  are  called  for,  all 
instructions  should  carry  the  memorandum  that  interviews  with 
minors,  maids,  etc.  will  not  be  accepted.  In  writing  the  name  and 
address  of  the  respondent,  be  sure  to  give  the  exact  name  of  the 
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individual.     This  is  to  prevent  confusion,  when  the  checkup  by- 
mail  is  made  later. 
Percentage  of  calls  in  each  class  of  home. 

3.  Time  limit,  and  when  material  is  to  be  sent  to  and  from  the  field. 

The  date  on  which  last  questionnaires  must  be  put  in  mail. 

How  material  is  being  shipped  to  the  field  worker. 

How  completed  work  is  to  be  returned.     (By  first-class  mail,  air 

mail,  special  delivery.) 
Whether  the   completed   questionnaires   are   to   be   returned   each 

night,  at  the  close  of  the  work,  etc. 

4.  Payment. 

Under  this  heading  state  the  price  to  be  paid  for  the  work,  indicating 
whether  this  includes  expenses,  postage,  etc.  The  rate  at  which 
assistants  are  to  be  paid  is  seldom  specified,  but  naturally,  enough 
should  be  paid  to  get. responsible  people  able  to  do  good  work. 

5.  Editing. 

Call  attention  here  to  the  necessity  for  careful  editing  of  all  question- 
naires. The  supervisor  is  responsible  for  the  quality  and  authen- 
ticity of  the  work  of  his  or  her  assistants*  consequently  he  must 
go  over  their  questionnaires  carefully. 

6.  The  Interview. 

Approach.     Describe  the  approach  to  the  prospective  respondent 

which  is  calculated  to  be  most  successful  in  getting  the  information 

sought. 
Description  of  Questionnaire.     Each  question  should  be  taken  up 

individually  and  explained.     In  a  simple  questionnaire  this  is  not 

always  necessary. 
Fullness  of  Comment.     On  questions  requiring   "reasons  why"  or 

other  full  answers,  it  is  advisable  to  instruct  the  field  worker  to 

write  the  answers  verbatim;  that  is,  using  the  respondent's  own 

words  and  in  the  first  person. 

7.  Miscellaneous. 

(Write  in  pencil.) 

Summary.     Instruct  the  field  worker  to  give  the  type  of  summary 

which  is  most  suitable  for  the  work  being  done.     This  can  be 

either  a  question-by-question  discussion  of  the  questionnaire,  or  a 

more  general  analysis  of  the  situation  as  the  field  worker  sees  it  in 

his  or  her  town. 
Authenticating.     It  is  a  good  idea  to  call  field  workers'  attention  to 

the  fact  that  letters  with  return  post  cards  are  sent  out  to  ascertain 

the  percentage  of  the  respondents,  asking  them  whether  or  not 

they  were  interviewed. 

Return  the  post  card  enclosed  with  the  material  to  indicate  that 

it  has  been  received  safely,  and  that  the  job  will  be  completed  on 

schedule. 
In  case  an  individual  field  worker  cannot  handle  the  survey,  he  is  to 

telegraph  us  at  once  and  hold  the  material  until  we  advise  him 

what  to  do  with  it. 
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Pursuing  this  general  outline  the  following  is  a  fully  developed 
instruction  plan  actually  used  in  connection  with  a  coffee  survey. 
These  exhibits  include  (a)  the  specific  instructions  to  the  inter- 
viewers, (6)  a  copy  of  the  questionnaire  and  (c)  a  copy  of  the 
explanations  concerning  the  questions  to  be  asked. 

INSTRUCTIONS  FOR  INTERVIEWS 

Glass  Vacuum-packed  Coffee  Survey 

Note:  If  you  cannot  handle  this  job,  hold  the  material  and  telegraph  us  at 
once. 

You  are  to  make completed  interviews  with  housewives.     We  will 

not  consider  as  complete,  nor  will  we  accept  questionnaires  which  have 
unanswered  questions  which  obviously  require  an  answer,  or  questionnaires 
not  having  sufficient  comment.  You  should  be  able  to  make  from  35  to  40 
completed  interviews  per  day,  possibly  more,  depending  on  how  many  have 
never  had  experience  with  glass  vacuum-packed  coffee. 

Purpose.  This  survey  is  to  learn  the  attitude  of  the  housewife  toward  the 
method  of  packing  coffee  in  glass  jars,  known  as  "Vacuum-packed  in  glass." 
It  does  not  refer  to  any  particular  brand  of  coffee  which  may  be  so  packed, 
but  rather  to  the  method  of  packing. 

Whom  to  Interview.  Interviews  are  to  be  made  with  housewives  or  female 
heads  of  the  home  only — no  children  or  maids.  The  interviews  should  be 
distributed : 

35  per  cent  Class  A  Homes 

50  per  cent  Class  B  Homes  i 

15  per  cent  Class  C  Homes 
No  Class  D  Homes 

Time.  Please  ship  completed  questionnaires  daily.  Your  last  ship- 
ment must  be  in  the  mails  not  later  than  Saturday,  December  1,  1934, 
although  we  would  greatly  appreciate  it  if  you  would  complete  this  work  at 
an  earlier  date,  if  possible.  The  following  cities  are  to  return  all  questionnaires 
by  air  mail:  Memphis,  Chicago,  Saint  Louis,  Duluth,  Minneapolis — Saint 
Paul,  Portland,  Seattle.  Harrisburg  and  Baltimore  may  use  first-class 
mail. 

Payment.     We  will  pay  you  at  the  rate  of  $ per  day  for  this  survey, 

plus  an  allowance  for  expenses  of  not  to  exceed  $ for  the  entire  job. 

In  addition  to  this  we  will  pay  your  postage  cost.  Please  send  us  a  memo- 
randum of  this  at  the  end  of  the  job. 

Assistance  and  Editing.  It  may  be  necessary  in  some  cities  to  obtain 
assistance  in  order  to  complete  the  quota  in  the  time  allowed.  You  are 
entirely  responsible  for  the  authenticity  and  quality  of  your  assistants' 
work.  Please  go  over  their  questionnaires  and  your  own  with  the  greatest 
care  to  see  that  each  one  follows  instructions  and  is  not  contradictory. 
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General.  (Write  in  pencil.)  Please  write  a  summary  of  your  impressions 
when  you  complete  this  work  and  give  us  any  details  which  you  think  would 
be  of  interest  to  our  client  and  which  do  not  show  up  in  the  questionnaire. 

Return  the  enclosed  post  card  to  indicate  that  you  have  received  the 
material  and  are  handling  the  job. 

Be  sure  to  keep  a  record  of  your  time,  as  well  as  that  of  your  assistants,  on 
the  local  time  record  enclosed.  This  must  be  returned  to  us  completely 
filled  in,  showing  expenses,  number  of  hours  put  in  by  you  (or  each  assistant), 
number  of  questionnaires  completed  in  this  time,  and  return  it  to  us  with 
your  last  questionnaires  in  order  that  we  may  certify  your  work  for  payment. 

The  following  is  the  questionnaire  to  which  the  foregoing 
instructions  refer: 

MARKET  RESEARCH  CORPORATION  OF  AMERICA 

Rockefeller  Center,  New  York,  New  York 
Consumer  Questionnaire 

Name House 


Apartment. 


Address Class  Homes :  A. 

Date ! 


City Interviewer 

Section  A  (All  interviews) 

1.  How  is  the  coffee  you  are  now  using  packed? 

Vacuum  tin Ordinary  tin Vacuum  glass Paper 

2.  Is  the  manner  in  which  it  is  packed  important  to  you? 

Yes No Why,  in  what  way? 

3.  If  not  using  coffee  vacuum-packed  in  glass  now,  have  you  ever  used  it? 

Yes No 

Section  B  (If  ''yes,"  past  users) 

4.  How  did  you  happen  to  start  buying  coffee  vacuum-packed  in  glass? 

Grocer  recommended Saw  displayed 

Advertising— Regular  coffee  changed  pack 

Friends  spoke  of 

5.  How  long  did  you  buy  coffee  vacuum-packed  in  glass  before  discon- 
tinuing*! 

Under  4  months 4  months  to  1  year Over  1  year 

6.  Why  did  you  discontinue  buying  coffee  vacuum-packed  in  glass? 
6a.  Did  you  attach  any  importance  to  the  cap  on  these  jars? 

Yes No Why  ? 

7.  What  did  you  do  with  jars  when  empty? 

8.  Did  you  consider  that  you  paid  a  premium  for  buying  coffee  vacuum- 
packed  in  glass?     Yes No 

9.  (If  "yes")  Were  you  willing  to  pay  this  premium? 

Yes No Why? 

Section  C  (If  glass  pack  never  used.     Non-users) 

10.  Why  have  you  never  used  coffee  vacuum-packed  in  glass? 
Section  D  (Present  Users) 
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11.  How  long  have  you  used  coffee  vacuum-packed  in  glass? 

Under  4  months 4  months  to  1  year Over  1  year 

12.  How  did  you  happen  to  start  buying  coffee  vacuum-packed  in  glass? 

Grocer  recommended Saw  displayed 

Advertising __     Regular  coffee  changed  pack 

Friends  spoke  of .     Other . 

13.  Why  do  you  like  it  this  way? 

14.  Do  you  attach  any  importance  to  the  cap  on  these  jars? 

15.  Do  you  leave  the  coffee  in  original  glass  package  until  used  up? 

Yes No 

16.  What  do  you  do  with  jars  when  empty? 

17.  Do  you  consider  that  you  pay  a  premium  for  buying  coffee  vacuum- 
packed  in  glass?     Yes No 

18.  If  "yes,"  are  you  willing  to  pay  this  premium? 

Yes No Why? 

Comments  : . 


Glass  Vacuum-packed  Coffee 

(Explanation  of  questionnaire  shown  on  preceding  page) 

The  Questionnaire.  In  making  the  interviews,  it  is  highly  important 
that  you  get  the  full  meaning  of  each  answer  and,  where  comments  are  called 
for,  give  the  comment  in  the  respondent's  own  words,  drawing  them  out 
and  giving  full  complete  answers.  Three-  or  four- word  phrases  are  not 
considered  full  answers  where  we  ask  for  comments.  If  your  questionnaires 
do  not  give  full  comments,  we  cannot  pay  you  for  the  work. 

Fill  in  the  name,  address  and  city  of  the  respondent  (be  sure  to  give  the 
name  of  the  individual  interviewed.  This  is  important  as  confusion  may 
result  when  we  make  our  mail  checkup,  if  you  give  the  name  of  the  head  of 
the  house,  or  someone  else  who  is  not  interviewed.) 

Indicate  whether  the  respondents  live  in  a  single-family  or  a  two-family 
house,  or  whether  they  live  in  an  apartment. 
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Indicate  with  an  "X,"  whether  the  home  is  A,  B  or  C  (refer  to  attached 
sheet  describing  class  of  homes).  Fill  in  the  date  and  your  name.  If  the 
questionnaire  is  made  by  an  assistant  write  her  name  and  the  supervisor's 
initials. 

The  questionnaire  is  divided  into  A,  B,  C  and  D  Sections,  as  follows: 
Section  A.     To  be  filled  out  by  all  respondents. 

Section  B.     To  be  asked  of  those  who  have  used  vacuum-packed-in-glass 
coffee,  but  are  not  using  it  at  present. 

Section  C.     To  be  asked  of  those  who  have  never  at  any  time  used  vacuum- 
packed-in-glass  coffee. 
Section  D.     Present  users  of  vacuum-packed-in-glass  coffee. 


Section  A  (all  interviews) : 
Question  1.  Self-explanatory. 

2.  This  question  calls  for  an  explanation  of  whether  or  not  the 
manner  of  packing  coffee  is  of  importance  to  the  housewife. 
We  would  like  this  question  to  be  answered  not  only  by  an 
"X"  mark,  but  also  would  like  to  have  you  draw  out  the- 
respondent  as  to  why,  and  in  what  way,  she  thinks  a  method 
o'f  packing  is  important.  The  respondent  at  first  may  reply 
that  the  method  of  packing  is  of  no  importance.  However, 
if  you  discuss  the  matter  with  her,  you  may  find  that  she  has 
definite  objections  to,  let  us  say,  packing  coffee  in  paper. 
Give  these  comments  in  her  own  words  and  then  go  back  and 
see  if  the  "X"  after  "yes"  or  "no"  conforms  to  her  com- 
ments; if  not,  change  it. 

3.  Self-explanatory. 

Section  B.  The  questions  in  this  section  are  to  be  asked  only  of  respond- 
ents who  have  used  coffee  vacuum-packed  in  glass  at  one  time  or  another, 
but  who  are  not  now  using  coffee  packed  in  this  manner. 

4.  Indicate  with  an  "X"  mark  how  the  respondent  happened  to 
start  buying  coffee  packed  in  glass.  If  some  reason  is  given 
other  than  those  indicated,  write  it  in  after  "other." 

5.  Self-explanatory. 

6.  This  question  is  important,  and  we  would  appreciate  it  if  you 
would  try  to  get  as  much  comment  as  possible.  Discuss  it 
with  the  housewife  so  as  to  be  sure  that  there  is  not  some 
reason  which  she  has  forgotten  for  the  moment,  but  which  a 
discussion  will  bring  out. 

6a.  In  getting  an  answer  to  this  question  it  is  necessary  for  us  to 
give  you  some  information  which  we  do  not  want  you  to  tell 
the  respondent,  nor  to  refer  to  in  any  Way  in  your  questioning. 
Our  only  reason  for  giving  you  this  information  here  is  that 
you  may  be  able  to  understand  and  note  the  answers  which 
the  respondent  may  give. 

Our  client  is  a  manufacturer  of  the  glass  containers  on 
which  this  survey  is  based.  All  glass  containers,  or  jars,  in 
which  coffee  is  packed  are  sealed  by  means  of  a  special  screw 


i 


176  THE  TECHNIQUE  OF  MARKETING  RESEARCH 

cap  which  is  easily  opened  by  the  housewife  and  which  when 
tightened  again  after  opening  reseals  the  jar,  making  it 
again  airtight.  This  is  done  by  means  of  a  special  rubber 
seal  in  the  inside  of  the  cap. 

When  you  ask  the  respondent  whether  she  attaches  any 
importance  to  the  cap  on  these  jars,  please  do  not  ask  any 
leading  questions  or  in  any  way  describe  this  cap.  Merely 
ask  the  question  as  stated  on  the  questionnaire  and  write 
down  the  answer  in  the  words  of  the  respondent.  We  are 
giving  you  this  description  so  that  if  she  states  that  she 
thinks  the  cap  is  important,  as  she  is  able  to  reseal  the  coffee 
airtight,  you  will  understand  what  she  means. 

7.  Find  out  not  only  what  use  was  made  of  the  jars,  but  whether 
or  not  they  found  use  for  all  of  them  in  this  way  and,  if  not, 
what  did  they  do  with  the  remainder  of  them  and  how  did  they 
feel  about  the  disposal  of  them. 

8.  Self-explanatory. 

9.  Wants  to  be  rather  carefully  handled  and  should  be  asked 
only  if  the  woman  has  definitely  intimated  in  question  8  that 
she  thought  she  was  paying  a  premium  for  vacuum-packed  in 
glass  coffee.  Here  again,  we  would  appreciate  your  getting  a 
full  explanation  as  to  why  she  thought  she  was  paying  a 
premium. 

Section  C.     To  be  asked  only  where  respondents  have  never  used  coffee 
vacuum-packed  in  glass. 

10.  Try  to  draw  out  respondent  and  find  out  definitely  why  she 
has  never  used  coffee  vacuum-packed  in  glass.  Of  course, 
the  answer  may  be  that  she  has  never  heard  of  it,  but,  if  she 
has  heard  of  it,  try  to  get  as  many  reasons  as  possible  as  to 
why  she  has  never  tried  it. 

Section  D.     Present  users  of  vacuum-packed  in  glass  coffee. 

11.  Self-explanatory. 

12.  This  question  is  similar  to  question  4  in  Section  B  and  should 
be  handled  in  the  same  manner. 

13.  Draw  out  the  respondent  as  far  as  possible  and  give,  in  her 
own  words,  a  full  answer  of  what  she  thinks  about  vacuum- 
packed-in-glass  coffee. 

14.  Carries  the  same  instructions  as  6a  and  should  be  handled 
in  the  same  manner. 

15.  Self-explanatory. 

16.  Carries  same  instructions  as  7  and  should  be  handled  in  the 
same  manner. 

17.  This  question  again  is  the  same  as  question  8  in  Section  B  and 
should  be  handled  in  the  same  manner. 

18.  This  question  is  the  same  as  question  9,  Section  B,  in  the  same 
manner. 

Comments.     The  remaining  space  is  to  permit  you  to  give  definite  comments 
regarding  the  interviews  and  any  information  which  was 
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brought  out  in  the  interview  but  which  was  not  called  for 
by  any  particular  question. 


So  far  in  this  chapter  we  have  limited  the  discussion  of  routine 
more  or  less  to  -the  interviewers.  A  routine  must  be  established 
also  for  supervisors,  inspectors  and  editors.  Because  these 
activities  are  inherent  in  the  operation  of  a  survey,  they  are  to  be 
treated  in  the  next  chapter.  Further,  if  the  tabulation  is  to  be 
done  manually,  a  routine  must  be  established  for  tabulators  and 
this  will  be  found  incorporated  into  Chap.  XII  on  the  Organiza- 
tion of  Data. 


CHAPTER  X 

OPERATION  IN  THE  FIELD 

(Elaboration  of  Chart  F,  Concluded) 

Having  considered  the  elements  of  organization — the  prepara- 
tion of  the  necessary  forms,  the  selection  and  training  of  the  field 
staff  and  the  development  of  a  routine  for  the  study — there 
remains  now  for  discussion  the  business  of  making  the  organiza- 
tion effective  in  the  field.  The  means  have  been  provided;  the 
point  now  is  to  carry  through  the  work  in  such  a  manner  as  to 
command  the  maximum  credence  for  the  results. 

Operation.  At  this  point  the  major  considerations  concern 
the  correctness  of  the  method  being  used,  the  competency  of  the 
personnel  and  the  skill  and  fidelity  with  which  the  staff  performs 
its  function  in  its  contacts  with  respondents.     - 

Every  phase  of  research  work  is  important,  of  course,  but  each 
phase  has  its  own  pitfalls.  The  research  person  can  take  nothing 
for  granted.  It  is  not  to  be  assumed,  for  instance,  that  because 
the  plan  being  used  was  successful  elsewhere  or  at  some  other 
time  it  is  necessarily  the  right  one  for  the  study  at  hand ;  or  that 
because  the  persons  who  make  up  the  staff  seem  to  be  ladies  and 
gentlemen  their  work  must  ipso  facto  be  beyond  question  or 
reproach.  There  are  too  many  flagrant  instances  to  the  contrary. 
In  marketing  research,  it  may  truly  be  said  that  eternal  vigilance 
is  the  price  of  accuracy. 

PRELIMINARY    TESTS  OF  PLANNING  AND  PERSONNEL.       The  first 

question  to  be  determined  is  whether  the  approach  is  correct  as 
planned.  That  is  to  say:  will  the  study — conducted  by  direct 
investigation,  by  telephone  inquiry,  by  mailed  questionnaires,  or 
by  multiple  personal  interviews,  whichever  may  have  been 
planned — reveal  demonstrably  the  truth  desired?  Will  the  study 
solve  the  problem? 

Long  experience  with  marketing  research  may  be  sufficient  in 
some  cases  to  indicate  whether  or  not  the  plan  of  approach  is  the 
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correct  one;  but  generally,  the  method  decided  upon  should  be  put 
through  some  preliminary  test. 

Whichever  of  the  several  methods  may  be  used,  the  testing 
process  is  to  set  it  in  motion  on  a  small  scale  and  under  controlled 
conditions.  It  is  then  possible  to  study  the  results  in  all  particu- 
lars— as  to  the  suitability  of  the  plan  itself,  its  workability  in 
practice  and  the  significance  of  the  information  obtained.  As  to 
the  questionnaire,  the  test,  especially  when  the  study  is  to  be 
made  by  " multiple  personal  interviews,"  would  be  designed  to 
show  whether  or  not : 

1.  The  questions  are  so  put  as  to  enable  the  respondent  to  answer  them 
intelligently. 

2.  The  questions  are  absolutely  clear. 

3.  The  questions  are  not  asked  in  such  a  way  as  to  influence  the  replies. 

4.  The  questions  are  designed  to  bring  out  specifically  the  information 
desired. 

5.  That  the  questions  as  written  present  no  unexpected  difficulty  to  the 
interviewer. 

6.  That   the    questionnaire   is    sufficiently    comprehensive    without   being 
unwieldy. 

7.  That  the  results  will  lend  themselves  to  either  statistical  or  interpre- 
tative analysis. 

8.  That  the  questions  give  neither  the  interviewer  nor  the  respondent  any 
opportunity  for  misinterpretation. 

By  " controlled  conditions"  is  meant,  of  course,  that  the  test 
must  be  carried  out  in  a  manner  and  under  circumstances  which 
simulate  in  all  details  the  conditions  which  would  surround  the 
projected  survey.  The  test  must  contemplate  the  same  geo- 
graphical areas;  the  same  types  of  people — as  to  race,  color,  age, 
sex,  occupation — in  the  same  proportions  as  they  would  likely 
appear  in  the  survey  itself;  the  same  general  type  of  interviewers; 
substantially  the  same  routine.  These  are  all  factors  which 
should  be  taken  into  account  in  testing  a  questionnaire  for 
extended  use. 

A  questionnaire  test  such  as  this  might  be  carried  on  in  a  series 
of  daily  personal  interviews.  The  results,  correlated  from  day  to 
day,  would  quickly  show  whether  the  questions  have  been  so 
framed  as  to  bring  out  the  desired  information,  whether  that 
information  can  be  relied  upon  as  strictly  without  bias  and 
whether  the  interviews  have  been  property  distributed.  This 
process  would  also  reveal  any  important  weaknesses  in  the  basic 
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features  of  the  questionnaire  or  in  its  handling  in  the  field  and  it 
would  clearly  suggest  any  changes  which  might  be  necessary  to 
perfect  that  questionnaire  for  use  in  the  wider  field. 

A  test  of  the  questionnaire  should  also  include  provisions  to 
determine,  by  the  same  process,  whether  the  method  by  which 
the  data  are  to  be  organized  for  analysis  is  sound  and  practical. 
For  this  purpose  it  is  not  necessary  actually  to  set  up  the  work 
sheets ;  but  it  is  highly  prudent  to  make  such  experimental  tabula- 
tions of  the  test  questionnaire  as  may  show  that  the  information 
is  being  obtained  in  the  form  best  suited  to  the  proposed  method 
of  analysis. 

supervision  of  field  work.  Certainly  no  extensive  staff  of 
interviewers  should  be  permitted  to  roam  the  field  without  super- 
vision. Supervision  serves  several  purposes.  It  represents  an 
extension  of  the  function  and  period  of  training;  actually,  it  is 
training  in  the  field.  It  impresses  the  interviewer  with  the  need 
for  careful  work;  it  assures  the  proper  handling  of  the  question- 
naire; it  forestalls  error  and  enhances  the  probability  of  accuracy; 
and,  generally,  supervision  serves  to  hold  the  field  work  more 
certainly  to  the  plan  prescribed  for  it. 

The  supervisor  must  possess  all  the  attributes  of  the  best  type 
of  interviewer;  he  must  have  some  training  and  experience  in  the 
executive  requirements  of  the  job  and  must  have,  in  some  degree, 
the  quality  of  leadership.  For  a  specific  job  the  supervisor  must 
have  some  advance  instruction  in  the  field  work  and  a  somewhat 
broader  comprehension  of  the  study  as  a  whole.  He  must  have 
all  the  equipment  necessary  for  teaching  and  managing  the  inter- 
viewers effectively.  Probably  the  most  important  function  of 
supervision  is  to  stress  the  ideal  of  perfect  impartiality,  complete 
disinterestedness,  freedom  from  bias.  Supervisors  should  preach 
this  attitude  of  objectivity — of  scientific  detachment — and  by 
sitting  in  on  some  of  the  interviews  they  should  see  that  the 
reporters  maintain  that  attitude. 

Theoretically  the  perfect  setup  would  be  to  keep  the  supervisors 
in  constant  touch  with  the  work  of  each  interviewer.  This,  how- 
ever, is  rarely  feasible  economically.  Nor  is  it  possible  so  to 
select  and  train  any  substantial  group  of  interviewers  as  to  give 
each  one  the  knowledge,  the  skill,  the  experience  and  the  point 
of  view  of  a  supervisor.  Supervision  must,  therefore,  be  based 
upon  such  factors  as  the  requirements  of  the  study,  the  area 
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being  covered,  the  type  of  persons  or  stores  being  interviewed, 
the  character  and  abilities  of  the  interviewers. 

The  extent  of  the  supervision  is,  necessarily,  a  matter  for  judg- 
ment in  each  case.  Normally,  a  staff  of  experienced  interviewers 
of  proven  ability— a  permanent  staff,  for  instance— would  require 
comparatively  little  supervision;  where  the  interviewers  have  been 
carefully  selected  and  trained,  a  little  preliminary  work,  a  few 
interviews,  might  materially  reduce  the  need  for  supervision; 
but  where  a  new  staff  is  put  together  for  a  single  research  opera- 
tion, supervision  is  critically  important. 

There  are,  of  course,  many  ways  of  exercising  supervision. 
The  field  force,  for  example,  might  be  kept  together  in  one  terri- 
tory for  a  day  or  two,  working  in  constant  touch  with  the  super- 
visor. Or,  a  small  staff  might  confine  itself  to  a  very  restricted 
area— say,  a  single  block— with  a  supervisor  available  to  the 
several  interviewers  immediately  after  each  call,  when  all  the 
details  and  circumstances  of  the  interview  are  fresh  in  their 
minds.  Or,  after  having  been  broken  in,  the  interviewers  could 
consult  the  supervisors  by  telephone  during  the  day  or,  perhaps, 
in  person  in  the  evening. 

As  previously  suggested,  a  special  field  force,  newly  recruited, 
presents  the  greatest  need  for  supervision.  Every  member  of 
such  a  staff  is  a  stranger,  alike  to  the  research  director  and  to  the 
work  Under  ordinary  circumstances,  no  more  than  eight  to 
twelve  such  interviewers  should  be  allotted  to  any  one  supervisor. 
He  should,  then,  rehearse  his  group  in  the  technique  of  the  pro- 
posed field  work  and  make  two  or  three  calls  with  each  member 
in  turn  He  should  begin  with  the  interviewer  he  regards  as  most 
likely  to  need  his  help  and  continue  with  the  others  throughout 
each  day.  Whether  he  should  forewarn  his  interviewers  by 
making  appointments  with  them  in  advance  or  just  pick  them  up 
on  their  routes,  at  random  and  unannounced,  is  a  matter  for 
judgment  in  each  case. 

inspection.  It  might  be  said  that  supervision  is  an  educa- 
tional process  running  concurrently  with  the  work,  while  inspec- 
tion follows  the  work.  The  purpose  of  inspection  is  twofold :  to 
confirm  the  fact  that  the  reported  interviews  actually  took  place 
and  that  the  information  obtained  was  correctly  recorded. 

There  are,  of  course,  several  ways  of  doing  this  inspection 
work     From  three  to  five  of  the  persons  reported  to  have  been 
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interviewed  might  be  called  by  telephone  on  the  following  day 
and  questioned;  or,  an  inspector  might  select  at  random  several 
of  the  questionnaires  returned  by  each  interviewer  the  evening 


We  are  conducting  a  nation-wide  investigation  of  the  consumer's  reac- 
tion   to by    having    investigators    call    on 

representative  people.  Our  investigator  reports  having  talked  with 
you  about  the  subject. 

We  should  greatly  appreciate  it  if  you  would  indicate  on  the  enclosed 
post  card  whether  one  of  our  investigators  actually  did  question  you 

about Please   check   the   correct   answer 

on  the  card.     The  card  is  stamped,  just  drop  it  in  the  mail. 

Let  me  assure  you  that  this  information  will  not  be  used  for  any  pub- 
licity purpose  or  in  any  way  to  annoy  you,  and  that  this  request  is  of 
no  other  purpose  than  to  check  up  on  our  investigators. 

Very  truly  yours, 

Market  Research  Corporation  of  America 


Fig.   17. — A  follow-up  form  letter. 

before  and  call  back  on  those  respondents  in  person.  If  tactfully 
handled,  neither  of  these  methods  should  antagonize  the  respond- 
ent.    In  large  surveys  covering  a  widespread  area,  a  form  of  mail 


Market  Research  Corporation  of  America 

ROCKEFELLER    CENTER 

1 250  Sixth  Avenue 

New  York,  N.  Y. 


Your  investigator  <    ,!  i  "'""""           >  call  on  me  recently  to 
question  me  about _ 


Name __.._ 

Address 

City 

Date 


Fig.    18 — The  return  postal  card. 

checkup  is  usually  employed.  A  reproduction  of  the  form  letter 
(Fig.  17)  used  in  such  follow-up  work  and  the  return  postal 
card  (Fig.  18)  referred  to  therein  are  shown  above.  In  some  cases, 
where  a  very  short  questionnaire  permits  the  entire  interview 
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to  be  reported  on  a  regular-sized  postal  card,  the  return  question- 
naires are  tabulated  and  some  of  them  are  mailed  back  to  the 
respondents  with  a  letter  asking  them  to  confirm  the  entire  inter- 
view.    A  sample  of  such  a  questionnaire  is  shown  in  Fig.  19. 

Whether  the  check  back  is  made  by  telephone,  by  mail  or  in 
person,  no  more  than  10  per  cent  of  the  work  of  each  interviewer 
is  normally  necessary  to  establish  the  authenticity  of  the  job. 
As  a  rule,  considerably  less  than  10  per  cent  is  sufficient.     If  a 


No.  47291 

Name 
Street 
City  &  State 


Phone  Date 


Dear  Radio  Listener: 

You  were  interviewed  by  telephone  on  the  above  date  and  were 
reported  as  giving  the  following  responses.     If  correct,  please  sign  and 

mail.     No  stamp  required. 

Do  you  have  a  radio?     Yes No Did  you  use  the  radio  last  night? 

Yes No List  programmes  you  listened  to : 


Check  (at  left)  those  you  enjoyed  most 
Signature  of  person  interviewed: 


M _F Int.  No.     Ed.     Tab. 


Fig.  19.— Postal  card  follow-up  with  complete  questionnaire. 

10  per  cent  check  is  made  by  mail,  for  instance,  probably  50  per 
cent  of  the  inquiry  or  checkup  cards  will  be  returned;  this  gives 
a  5  per  cent  check  on  the  work  of  each  interviewer.  Under 
ordinary  circumstances,  this  would  be  adequate;  and  if  any 
unusual  situation  is  revealed,  such  as  the  return  of  a  suspiciously 
high  percentage  of  letters  with  incorrect  names  and  addresses, 
additional  checkups  could  be  made  on  the  work  of  the  doubtful 
interviewer. 

Where  the  interviewers  are  thoroughly  familiar  with  this  system 
of  inspection,  as  they  should  be,  and  realize  that  an  entirely 
impersonal  verification  is  being  made  on  everyone's  work,  the 
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system  represents  in  itself  a  deterrent  from  indifferent  or  careless 
reporting.  Examples  of  deliberate  falsification  and  misrepre- 
sentation, in  any  reasonably  well  selected  group  of  interviewers, 
are,  fortunately,  rare. 

editing.  This  procedure  may  be  regarded  as  a  means  of 
further  inspection  and  also  as  a  step  in  the  organization  of  the 
data.  As  an  inspection  process,  each  completed  questionnaire 
should  be  carefully  read  through,  every  answer  being  studied  for 
completeness  and  clarity  and  checked  for  qualifying  or  contra- 
dictory replies.  Editing  is  also  a  rectifying  process.  It  is  by 
this  means  that,  for  interpretative  purposes,  adjustments  are 
made  to  bring  together,  to  "  articulate/'  all  the  reflections  which 
relate  to  the  same  point,  no  matter  how  these  reflections  may  be 
scattered  over  the  questionnaire.  Incidentally,  such  adjust- 
ments, corrections  and  changes  are  customarily  made  in  colored 
pencil  or  ink,  to  distinguish  them  from  the  reporter's  own  work 
in  the  field. 

As  a  step  in  the  organization  of  the  data,  it  is  at  this  point  that 
the  coding  of  the  questionnaire  is  to  be  completed.  It  is  likely 
that  some  of  the  items  were  coded  while  preparing  the  question- 
naire; and  probably  the  questions  then  left  uncoded  were  those 
on  which  the  character  of  the  answer  could  not  have  been  antici- 
pated with  any  assurance. 

To  classify  the  answers  to  questions  on  which  precoding  was 
not  feasible,  it  is  usually  sound  practice  to  analyze  several 
hundred  questionnaires,  selected  from  different  interviewers  in 
different  parts  of  the  territory.  This  establishes  some  general 
headings  under  which  the  various  answers  might  fall.  Under  this 
process,  it  will  generally  be  found  that  the  same  type  of  answer 
appears  repeatedly  and  that  a  well-defined  pattern  soon  begins 
to  emerge.  A  code  sheet  can  then  be  built,  listing  these  various 
answers  in  accordance  with  the  frequency  of  their  recurrence. 

The  building  up  of  a  code  sheet  is  highly  useful  in  the  interpreta- 
tive phase  of  research  work;  the  process  of  coding  assures  a  certain 
uniformity  of  interpretation.  In  cases  where  all  of  the  interpreta- 
tion is  to  be  done  by  one  individual,  coding  is  not  so  necessary;  the 
individual  is  likely  to  be  fairly  uniform  in  his  thinking  without  a 
code.  As  a  matter  of  fact,  the  editing  and  coding  should  be 
limited  to  not  more  than  two  or  three  people  in  any  case,  so  that, 
by  virtue  of  frequent  consultation,  they  may  maintain  the  necessary 
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uniformity  of  interpretation.  For  illustrative  purposes,  Fig.  20 
presents  a  questionnaire  form  showing  the  editing  marks,  and 
Fig.  21  presents  a  sample  code  sheet. 

The  editor  is  also  charged  with  the  responsibility  of  weeding  out 
any  substandard  work.  Even  with  the  greatest  care  there  are 
invariably  differences  in  the  work  of  groups  of  interviewers. 
These  differences  have  to  be  smoothed  out.  And,  frequently, 
individual  reports,  either  through  lack  of  cooperation  on  the 
part  of  the  respondents  or  error  on  the  part  of  the  interviewers, 
are,  as  written,  unsuited  for  inclusion  in  the  final  results.  All 
such  imperfections,  all  discrepancies,  all  irrelevant,  incongruous 


I  If 

AUBURN 

BUICK 

CADILLAC 

CHEVROLET 

CHRYSLER 

DESOTO 

DODGE 

DUESENBERG 

FORD 

GRAHAM 

HUDSON 

LAFAYETTE 

LASALLE 

LINCOLN 

NASH 

OLDSMOBILE  ' 

PACKARD 

PIERCE  ARROW 

PLYMOUTH 

PONTIAC 

REO 

STUDEBAKER 

TERRAPLANE 

ESSEX 

BUGATTI 

M.  G.  MIDGET 
S.  S. 

OTHER 
(STATE) 

NATIONAL  AUTOMOBILE  SURVEY 
MARKET  RESEARCH  CORPORATION 

OF  AMERICA 
NEW  YORK                          CHICAGO 

•WHY? 

L                 MOST                                         j 
IN  APPEARANCE? 

/fo&MTX.  Cine. 

£                 LEAST'1 

IN  APPEARANCE? 

/ 

/fa^fy 

4               MOST                           > 
MECHANICALLY? 

7 

'■^  C/ieap  flUt&v     -^ 

) 

«.                LEAST 

MECHANICALLY? 

•  ' 

V 

^■■^hmt  G77i4M^c^c<p^\ 

/ 

5.    WHAT  MANUFACTURER                                                          \ 
HAS  THE  BEST  CHANCE                                                 v 

fctvt  Mutirvu 

6.    WHAT  MANUFACTURER 
HAS  THE  POOREST  CHANCE 

• 

*(g} 

->■ 

7.      WHAT  CAR  DO  YOU 

EXPECT  TO  BUY                                    1/ 
NEXT? 

T 

£lke  CLfpmixmc^. 

8.     WHAT  MAKE  OF  CAR 
DO  YOU  NOW 

OWN?                                                   1 

1     ■   ' 

9.     HOW  SOON  DO  YOU  EXPECT. 

TO  BUY  A  NEW  CAR> 
1  K0._3  Mp.t^6  M0._l-2«tS._0VR.JYAS._ 

M*/  F B EST.   A  2D 

iNT.Ais 

"Editor's  notes:  In  the  first  ins 
is  no  answer  to  that  questic 


!  reporter  had  obviously  v 


:  /eclies  in  the  wrong  spaces; 


■is  noting  the  fact  that  thetB 


Fig.  20. — Questionnaire  showing  editor's  marks. 

and  manifestly  erroneous  matter  must  be  eliminated.  To  safe- 
guard the  study  from  distortions  which  might  arise  from  such 
questionable  field  work,  editors  should  be  given  a  free  hand  in 
discarding  or  retaining  all  material  according  to  their  own 
judgment. 

It  is  further  the  function  of  editors  to  watch  alertly  for  answers, 
comments  or  new  material  that  may  be  sufficiently  significant  to 
justify  verbatim  reproduction.  Such  material  may  take  the 
form  of  typical  examples  or  of  general  information,  which  may 
elaborate  and  support  the  statistical  background  of  a  study  and 
add  considerably  to  the  final  report  itself.  Not  infrequently 
extremely  interesting  and  hitherto  unknown  points  are  suggested 
or  brought  out  in  the  editing  process.     It  is  not  unusual,  for 
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Sample  Code  Sheet 


Question  4.     Table  3. 

A        HABIT 

B         TASTE FLAVOR TOASTED 

(Cool,  mentholated,  refreshing,  spicy,) 

C  BLEND 

D  MILD DELICATE 

E  STRONG 

F  SWEET 

G  SMOOTH 

H  AROMA 

K      quality  (better  tobacco) 

L/  UNIFORMITY 

M     throat — mouth    ease     (never    harsh, 
don't  burn — irritate) 

N        PRICE 

O       premiums    (combines    merchandise   of- 
fers, etc.) 
P       no  after  effects 

R        BURN     EVENLY WELL    MADE     (no     grit, 

dust,  firmly  rolled) 
S       prefers  tips  (cork,  straw) 

T         CONDITIONS      OF     MANUFACTURE      (pure, 

inspected,  union) 
U      no  definite  reason  (no  answer,  etc.) 

Question  6.     Table  4. 

a      tired  of  taste 

B       too  mild  (tasteless) 

C         TOO     STRONG HARSH BAD     AFTER     EF- 
FECTS (burn,  irritate,  dizzy) 
D       NOT  uniform 

E         TOO    DRY LOOSELY    PACKED    (bum    tOO 

quickly) 
F       too  expensive  (to  save  money) 

G         HARD  TO  OBTAIN 

H 
K 
L 

M 
N 
O 

P 
B 

S 
T 


PREFERS  cork  tips 

friends  smoke  (wife,  husband) 

PRESENT     BRAND     BETTER PURER 

LIKES  PRESENT  BRAND  BETTER 
MEDICAL DENTAL  ADVICE 

no  definite  reason  (don't  know,  etc.) 


Question  8.     Table  6. 
10-0     improves  appearance 


2 
3 
4 

5 
6 

7 
8 
9 
11-0 
1 
2 
3 
4 
5 


cleaner  (no  tobacco  on  lips,  no  loose 

ends) 

don't  get  soggy 

protection  to  lips 

luxurious sophisticated 

SWANKY 


DETRACTS  FROM  APPEARANCE 
TOO  EXPENSIVE 
UNNECESSARY 
TOO  SLIPPERY 
STICKS  WHEN  WET 

stale  taste  (kills  flavor) 

DRY  UP  TOO  FAST 


6       INDIFFERENT NO  ANSWER 


Question  12.     Table  10. 

15-0 

GOOD 

1 

LIKES  MILD MILDER 

2 

LIKES  CORK  TIPS 

3 

LIKES  AROMA 

4 

LIKES  TASTE 

5 

PLEASANT 

6 

GOOD  STRONG  CIGARETTE 

7 

LIKES  FOR  CHANGE 

-0 

TOO  MILD 

1 

TOO  SWEET 

2 

don't  like  cork  tips 

3 

don't  like  taste 

4 

QUALITY     REDUCED     W 

DUCTION 
TOO  DRY 
TOO  EXPENSIVE 
TOO  TIGHTLY  ROLLED 

NOT  DISPLAYED HARD  TO   GET 

INDIFFERENT NO  ANSWER 


Fig.  21. — Sample  code  sheet  giving  the  code  numbers  for  all  the  predictable 
replies  to  certain  of  the  questions  which  appear  on  the  schedule  shown  in  Fig.  22. 
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instance,  to  find  a  completely  new  use  for  a  product;  a  construc- 
tive criticism  or  a  recommendation  which  might  otherwise  never 
come  to  light;  a  startling  new  copy  slant,  or  a  theme  for  an 
advertising  campaign;  or  a  consensus  regarding  some  unsuspected 
aspect  of  the  product.  These  discoveries  may  be  totally  unrelated 
to  the  actual  purpose  of  the  study  and  yet  represent  a  highly 
important  by-product. 

The  ability  to  recognize  these  sometimes  subtle  reflections  is 
a  major  qualification  for  an  editor.  They  should  be  marked, 
immediately  upon  discovery,  to  identify  them  with  the  question- 
naire on  which  they  originated;  then  they  should  be  typed, 
carefully  studied  and  analyzed  in  the  light  of  their  suitability 
for  the  final  report. 

Where  the  editing  is  delegated  to  several  persons  it  is,  of  course, 
advisable  to  reduce  their  instructions  explicitly  to  writing,  so 
that  there  can  be  no  misunderstanding  as  to  the  manner  m 
which  the  editors  are  to  handle  the  mechanical  part  of  their 
work.  A  sample  of  such "  instructions  for  editors  is  shown  in 
detail  below.  And  in  Fig.  22  is  shown  the  questionnaire  to 
which  the  instructions  refer. 

Editor's  Instructions 
Questions  1,  2,  3  and  4  are  to  be  handled  as  one  group.     The  procedure 
for  editing  these  is  as  follows: 

Questions  1,  2,  3  and  4. 

Write  in  the  space  to  right  of  the  cigarette  names,  a  number  corresponding 
to  the  code  number  for  the  brand  or  brands  that  have  been  checked  by 
respondent— As,  4  for  Lucky  Strikes,  5  for  Marlboro,  etc. 

Plain  or  cork  tips  from  Question  2  are  to  be  designated  by  P  or  O  and 
this  letter  placed  immediately  to  the  right  of  the  number  just  written  in— 
(As  Philip  Morris  if  checked  would  be  coded— 8C  or  8P. 

The  second  figure  in  the  code  found  in  the  column  to  right  of  the  check 
in  Question  3  is  to  be  written  in  by  the  editor  in  line  with  the  previous 
notations  in  Question  1.  Example-Camels-plain,  smoked  over  two  years 
becomes  O-P-3. 

The  reasons  given  in  Question  4  are  to  be  carefully  compared  with  the 
mimeographed  code  of  reasons  furnished  to  each  editor  and  identified  by  the 
code  symbol  in  the  code  to  which  they  most  nearly  correspond  (see  Fig  21) 
Use  your  very  best  judgment  in  coding  these  reasons  correctly.  If  you  are  at 
a  loss  as  to  the  proper  classification,  ask  the  supervisor.  As  there  may  be 
more  than  one  reason  for  preference  given,  there  may  be  several  code  letters 
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required  to  be  written  in  in  the  same  line  or  lines  as  your  previous  notations 
in  1.  Example:  Camels — plain — smoked  over  2  years — preferred  because 
of  reasons  B  and  E  would  be  coded — 0-P-3-BE. 

Questions  5  and  6. 

To  be  coded  according  to  the  same  procedure  as  was  followed  in  Questions 
1  to  4  inclusive.  A  separate  code  of  reasons  for  switching  is  furnished  each 
editor.     (See  Fig.  21.) 

No  answer  to  6  (Why  switched?)  is  to  be  considered  D.K.  (don't  know) 
and  so  coded. 

If  Question  5  has  no  answer  and  6  is  answered,  draw  diagonal  lines 
through  6. 

Questions  7  and  8. 

If  respondent  now  smokes  cork  tips,  under  Question  2,  edit  out  Questions 
7  and  8.  Edit  out  all  reasons  applying  to  the  cigarette  itself  but  not  to  the 
cork  tips.  If  this  eliminates  the  only  reason  given  under  reasons — edit 
this  as  No  Answer. 

Questions  9  and  10. 

No  coding  needed  but  edit  as  required. 

Question  11. 

No  Answer  to  be  given  here  if  Tareytons  are  mentioned  in  1  and/or  5. 
If  mentioned  in  1  or  5  and  an  answer  is  written  in,  cross  it  out. 

Question  12. 

If  answer  to  11  is  "No,"  cross  out  the  opinion  in  12. 
If  answer  is  "Yes,"  consult  your  12  code  of  opinions  and  insert  correct 
symbol. 

Type -age :  If  type  or  age  is  missing,  consult  supervisor. 
Occupation:  If  occupation  is  not  given,  throw  into  the  retired  (group  7). 
The  occupations  have  been  regrouped  into  7  divisions  as  follows: 
j  Junior  Executives  4.  Salesmen  and  Clerks 

\  Senior  Executives  5.  Students 

2.  Professional  6.  Housewives 

3.  The  three  labor  groups  7.  Retired— Miscellaneous,  No  Answer. 
General:  Whenever,  in  the  questionnaires,  there  is  no  answer,  when  one 
should  be  shown,  write  in  an  X  within  a  circle,  to  indicate  No  Answer.  This 
applies  to  all  except  the  four  questions  for  which  code  lists  have  been  supplied. 


CHAPTER  XI 
PSYCHOLOGICAL  TECHNIQUE  OF  CLASSIFICATION1 

There  can  be  no  doubt  but  that  the  improper  classification  of 
questionnaire  returns  is  responsible  for  much  error  in  marketing 
research.  This  proneness  to  error  has,  in  fact,  greatly  retarded 
the  development  of  marketing  research.  It  strikes  in  two  ways : 
First,  the  prevalence  of  mistakes  in  data  classification  has 
endangered  the  reputation  of  marketing  research  as  a  scientific 
and  practical  method  of  arriving  at  true  conclusions.  Second, 
classification  difficulties  have  driven  research  men  back  more  and 
more  to  primitive  sorts  of  studies. 

Jenkins2  affirms  that  a  certain  important  research  agency 
came  to  the  conclusion  that,  wherever  possible,  questions  should 
require  only  the  answer  "Yes"  or  "No."  From  the  point  of 
view  of  wealth  and  importance  of  results,  just  the  contrary  is 
true.  But  most  research  men  have  been  so  harassed  by  the 
difficulties  and  uncertainties  in  classifying  returns,  particularly 
in  the  more  complex  studies,  that  many  of  them  are  making  a 
virtue  of  their  distress  and  are  pointedly  refraining  from  certain 
types  of  questions  which,  psychologically,  are  very  much  worth 
while. 

The  classification  of  returns  is,  so  to  say,  the  medium  through 
which  the  psychological  raw  material,  contributed  by  all  of  the 
respondents,  is  conveyed  to  the  analyst  for  effective  fabrication 
into  a  final  report.  If  the  material  is  spoiled  in  its  transmission, 
no  skill  of  the  fabricator  can  make  up  for  the  resulting  waste  of 
energy  and  for  the  loss  of  valuable  information.  Unfortunately, 
no  writer  so  far  has  given  sufficient  attention  to  the  technicalities 
of  a  psychologically  satisfactory  classification.     For  that  reason 

1  This  discourse  has  been  interpolated  here  because  of  the  importance  of 
"classification"  in  the  Organization  of  Data,  which  is  the  subject  of  the 
chapter  following  this. 

2.Jenkins,  John  G.,  Psychology  in  Business  and  Industry,  John  Wiley  & 
Sons,  Inc.,  New  York,  1935. 
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the  subject  will  be  stressed  here.  With  this  end  in  view,  the 
following  discourse  will  be  related  to  four  "  requirements "  which 
will  be  explained  as  clearly  as  possible  and  illustrated  by  concrete 
examples. 

In  order  to  be  satisfactory,  a  classification  has  to  fulfill: 

Requirement  1.  It  must  be  articulate.  This  means  that  the 
classification  should  be  built  up  in  a  series  of  steps,  each  resting 
on  and  leading  to  the  next. 

Requirement  2.  It  must  be  psychologically  adequate.  This 
means  that  the  classification  should  follow,  point  by  point,  the 
divisions  which  obtain  in  the  process  actually  underlying  the 
problem  in  question. 

Requirement  3.  It  must  be  logically  correct.  This  means  that 
the  classification  cannot  coordinate  in  the  same  step  items  of 
different  generality  or  reported  under  different  aspects. 

Requirement  4.  It  must  be  psychologically  pertinent.  This 
means  that  in  cases  where  respondents  have  a  margin  of  choice 
as  to  how  they  may  understand  a  question,  a  special  classification 
step  must  be  interjected  to  provide  a  place  for  each  aspect  and 
for  each  level  of  generality  represented  in  the  returns. 

The  elaboration  of  these  four  headlines  proceeds  as  follows: 

Requirement  1:  Articulate,  Proceeding  in  Several  Steps. 
The  purpose  of  a  classification  is  to  bring  into  order  elements 
which  are  given  in  too  great  a  number  to  be  dealt  with  indi- 
vidually and  separately.  They  are  put  into  groups,  which  are 
necessarily  less  numerous  than  the  single  items,  in  order  to  make 
the  material  easier  to  survey.  The  items  of  each  group  must  be 
as  similar  as  possible,  so  that  they  can  be  dealt  with  simulta- 
neously. If  the  items  are  people,  they  must  be  persons  of  similar 
inclination,  so  that  they  can  be  appealed  to  in  a  similar  way;  if 
the  items  are  statements,  they  must  be  of  similar  meaning,  so 
that  they  can  all  be  interpreted  alike— and  so  on.  The  whole  pro- 
cedure leads,  however,  to  something  like  a  contradiction.  If,  for 
the  purpose  of  easy  survey,  only  a  few  groups  are  constituted, 
a  great  many  elements  must  be  put  into  each  group  and  they  will 
hardly  be  similar;  if,  in  order  to  conjoin  only  similar  elements  the 
groups  are  made  small,  the  number  of  groups  will  be  great  but 
not  easy  to  survey.  As  a  solution  of  such  a  dilemma  "  articulate  " 
classification  is  used;  that  is  to  say,  the  groups  are  built  on 
different  steps.     On  the  first  step  only  a  few  groups  are  made; 


192  THE  TECHNIQUE  OF  MARKETING  RESEARCH 

on  the  next  step  each  of  these  groups  is  subdivided;  then,  the 
subdivisions  are  divided — and  so  on,  down  to  the  smallest 
groups  with  which  the  study  may  be  concerned.1 

Where  a  quick,  cursory  survey  is  sufficient,  only  the  first  steps 
of  the  classification  may  be  used.  But  when  a  closer  study  is 
required  and  details  are  important,  it  may  become  necessary  to 
analyze  each  step  in  turn  until  the  very  ultimate  division  is 
reached. 

The  first  example  is  taken  from  a  study  conducted  by  the 
Superintendent  of  Schools  in  Essex  County,  New  Jersey,  to  find 
out  just  what  were  the  main  problems  of  the  youngsters  in  his 
territory.  One  of  the  questions  was:  "  What  can  the  community 
do  for  its  youth?"2 

The  replies  were  so  numerous  and  so  diversified  that  only  a 
very  articulate  classification  could  help  in  their  analysis.  Here 
is  a  table  summarizing  in  percentages  the  replies  of  2,000  boys: 

A.  Employment 24 . 5 

1.  More 18.7 

2.  Better  conditions 5.8 

B.  Education ' 16.4 

1.  High  school 3.9 

2.  Free  college 3.8 

3.  Free  vocational  schools : 2.0 

4.  Free  adult  education 4.6 

5.  General  comments 2.1 

C.  Improved  recreation  facilities 29 .  6 

1.  Community  centers , 9.8 

2.  Outdoor  activities 14. 9 

a.  Parks  and  playgrounds 6.2 

b.  Swimming  pools •  •  •  •    *>  •  ^ 

c.  Others 3.4 

3.  Clubs 4.9 


1  That  is  precisely  the  "method  of  study"  referred  to  in  the  introduction 
of  this  work  as  constituting  the  essence  of  research.  As  a  means  to  under- 
standing, the  process  is  as  sound  today  as  it  was  three  hundred  years  ago 
when  formulated  by  Descartes  in  his  Discourse  on  Method. 

2  Although  this  was  not  undertaken  as  a  market  study,  the  procedure  is 
actually  the  same  as  if  the  problem  were  to  find  out,  by  a  market  survey, 
how  to  improve  the  editorial  policy  of  a  magazine  or  how  to  run  a  Dight  club. 
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D.  Improved  library  facilities 0.3 

E.  Miscellaneous  suggestions 5.1 

F.  No  requirements  stated 24. 1 

100.0 

The  major  steps  can  be  identified  by  the  capital  letters;  the  first 
subdivisions  by  the  numerical  figures  and  a  further  breakdown 
of  at  least  one  of  the  subdivisions,  " outdoor  activities,"  is 
indicated  by  the  lower-case  letters.  These  represent  three 
steps. 

Such  an  articulation  is  of  great  practical  value  in  different 
respects. 

First,  the  articulate  classification  makes  much  easier  reading. 
Instead  of  overwhelming  the  reader  with  a  long,  monotonous  list 
of  figures,  he  is  given  an  opportunity  to  start  with  the  first  step ; 
then,  after  he  has  gotten  the  main  idea,  he  passes  easily  to  the 
next  step — and  so  on.  On  the  first  step,  he  will  see  that ' '  employ- 
ment" and  " recreation"  are  the  two  chief  desires  of  these  young 
people,  everything  else  being  of  minor  importance.  On  the 
second  step,  he  might  study  the  four  main  educational  require- 
ments, taken  by  themselves,  without  reference  to  the  employ- 
ment and  recreation  requirements.  These  latter  ideas  he  has 
put  in  store,  so  to  say,  on  the  first  step.  On  the  third  step  he  can 
compare  the  different  outdoor  activities  for  themselves. 

Second,  with  the  articulate  classification  one  can  adapt  the 
presentation  to  the  amount  of  figures  at  hand.  The  table  in 
this  example  covers  2,000  cases  and,  therefore,  even  on  the  third 
step  the  figures  are  still  statistically  important.  Suppose,  how- 
ever, that  one  wanted  to  compare  three  age  groups.  Then,  all 
of  the  figures  would  be  reduced  to  approximately  one-third  and, 
on  the  third  step,  'they  would  become  too  small  to  be  reliable. 
In  such  an  event,  even  on  the  second  step,  the  figures  may  not  be 
completely  trustworthy.  But,  certainly,  the  first  step  is  sound 
statistically,  and  with  that  step  alone  the  articulate  classification 
would  enable  one  to  develop  with  safety  the  comparative  table 
shown  on  page  194. 

It  is  apparent  at  once  that  with  increasing  age  the  worry  about 
employment  displaces  the  earlier  interest  in  recreational  facilities. 
Working  in  the  same  way  on  the  different  steps,  the  classification 
as  a  whole  reveals  many  interesting  reflections.     But  since  the 
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concern  here  is  with  the  procedure  and  not  with  the  content  of 
the  table,  there  would  be  no  point  in  further  elaboration.     , 


Requirements 


A.  Employment. 

B.  Education 

C.  Recreation.  . . 

D.  Library 

E.  Miscellaneous 

F.  No  choice 


16-18 
years 


17.2 
17.0 
35.6 
0.2 
4.0 
26.0 


100.0 


19-21 
years 


30.5 
15.4 
25.0 
0.5 
5.5 
23.1 


100.0 


22-24 
years 


31.2 
15.3 
22.4 
0.5 
7.0 
23.6 


100.0 


The  chief  importance  of  Requirement  1  lies  in  the  fact  that 
only  in  connection  with  articulate  classification  is  it  possible  to 
carry  through  the  two  other  requirements  which  are  next  to  be 
discussed.  One  of  these  is  a  psychological  requirement  and  the 
other,  a  logical  one.  The  psychological  one  will  be  presented 
first. 

Requirement  2:  Psychologically  Adequate,  Matching  an 
Actual  Process.  At  each  step  of  the  classification  it  is  neces- 
sary to  choose  anew  the  groups  to  be  constructed.  For  certain 
topics  these  groups  are  rather  evident,  either  because  tradition 
provides  a  well-established  scheme  or  because  the  distinctions 
between  and  within  the  various  groups  are  so  readily  perceptible. 
If  the  attributes  of  good  food  are  being  dealt  with,  for  example, 
there  must  arise  somewhere  the  distinction  between  smell, 
appearance,  taste  and  consistency,  according  to  the  traditional 
distinction  of  the  senses — the  acoustical  sense  not  being  involved. 
If  advertising  media  are  under  consideration,  distinctions  will 
readily  occur  between  radio,  magazines,  newspapers,  billboards 
and  premiums — because  the  difference  is  physically  so  evident. 

Market  research,  however,  often  brings  up  topics  which  present 
much  less  obvious  distinctions.  What  people  require  in  connec- 
tion with  certain  products,  the  reasons  they  volunteer  for  shifting 
away  from  a  brand,  the  activities  they  report  as  especially  pre- 
ferred and  many  other  such  problems  furnish  rather  abstract 
items  for  a  classification. 
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To  fulfill  the  second  requirement  for  satisfactory  classifications 
in  such  cases,  it  is  necessary  to  visualize  the  concrete  procedures 
or  activities  which  are  implied  in  those  items.  One  must  have 
in  mind  a  concrete  picture  to  which  all  of  the  comments  to  be 
classified  are  likely  to  refer.  By  analyzing  in  accordance  with 
such  a  scheme,  one  ultimately  obtains  a  classification  into  which 
all  of  the  items  will  fit  best.  An  example  will  clarify  the 
idea. 

Women  comment  upon  cosmetics.  They  have  a  great  many 
requirements  which  are  hard  to  group,  if  they  are  just  piled  up 
the  way  they  are  turned  in.  But  visualize  a  woman  using  cos- 
metics. She  uses  them  in  order  to  look  better;  but  she  is  afraid 
that  she  might  spoil  her  skin;  there  are  technical  problems  in 
the  handling  and  applying  of  cosmetics  with  which  she  is  con- 
cerned; and,  finally,  the  whole  affair  should  not  be  too  expensive. 
Just  see  how  easily  all  of  the  many  comments  fit  into  these  four 
groups:  appearance,  safety,  technicalities,  economy.  The  rea- 
son is  that  the  scheme  of  classification  matches  the  actual  pro- 
cedure of  using  cosmetics.  It  is  precisely  from  that  process  that 
the  respondents  have  themselves  taken  their  requirements. 
The  classification,  so  to  speak,  puts  the  comments  right  back 
where  they  came  from. 

To  formulate  once  more  the  general  procedure:  A  situation 
or  a  process  is  visualized  which  serves  as  a  frame  of  reference  for 
the  whole  list  of  comments  to  be  classified,  as  required  by  the 
study.  This  situation  or  process  is  then  divided  into  its  different 
natural  parts  at  the  same  time  as  the  further  classification 
proceeds.  The  thought  moves  in  two  directions,  building  up 
from  the  list  of  comments  an  organized  whole  and  concurrently 
dividing  this  whole  back  into  parts.  Finally,  the  two  tendencies 
will  have  to  meet.  To  put  it  another  way:  The  line  of  progress 
is  not  directly  from  the  single  answer  of  a  respondent  to  a  group 
into  which  it  might  fit;  it  proceeds  rather  from  the  single  answer 
to  a  general  pattern  which  seems  to  be  at  stake;  from  this  pattern 
the  thought  then  turns  to  the  segregated  parts  and  here  are 
found  the  adequate  groups  for  the  classification.  The  best 
evidence  of  a  classification  psychologically  adequate  is  that  no 
single  item  is  left  outside  the  classes  and  that  at  the  same  time  no 
class  is  used  which  does  not  combine  with  the  other  classes  to  a 
significant  unit. 
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Here  is  another  general  example  which  demonstrates  the 
requirement  of  psychological  adequacy  on  different  steps  of  an 
articulate  classification.  Suppose  it  is  necessary  to  classify  all 
of  the  methods  manufacturers  might  use  to  improve  their  radio 
sales  in  a  certain  city.  First,  the  general  procedure  of  marketing 
is  visualized:  The  manufacturer  has  a  product;  by  some  methods 
and  means  he  gets  in  touch  with  dealers,  who  comprise  his  market, 
and  he  works  out  the  terms  or  policies  under  which  the  dealers 
are  to  profit  by  purveying  his  goods  to  the  consumer.  The 
"product,"  the  "methods  and  means,"  the  " market,"  and  the 
manufacturer's  " policies"  are,  obviously,  the  natural  elements 
of  the  whole  process.  It  is  in  accordance  with  these  four  ele- 
ments, therefore,  that  all  the  methods  which  might  be  employed 
to  improve  the  sale  of  radios  must  be  classified  for  study.  Relat- 
ing the  possible  methods  to  this  broad  classification  represents 
the  first  step. 

The  second  step  would  be  to  divide  each  of  these  four  elements 
into  its  obvious  parts  and  to  relate  to  each  part  those  possible 
methods  of  improvement  which  specifically  apply.  To  illustrate : 
Consider  the  element  first  named — "the  product."  What  do 
people  want  in  a  radio?  They  want  something  attractive 
in  appearance;  they  want  its  performance  to  be  entirely  sat- 
isfying and  they  want  the  set  to  cost  as  little  as  possible.  As 
a  result  of  the  second  step,  one  of  the  major  elements,  the 
product,  has  been  divided  into  three  parts — appearance,  per- 
formance and  cost.  Any  methods  of  improvement  which  con- 
cern the  product  must  relate  to  one  or  more  of  these  specific 
elements. 

For  the  third  step,  each  of  these  three  elements  would  be 
divided  into  its  components.  It  is  obvious,  for  instance,  that 
"performance"  comprises  volume,  tone,  flexibility,  clarity;  and 
each  of  these  may  suggest  methods  of  improvement.  As  a 
fourth  step,  these  items  would  be  resolved  into  their  respective 
parts — as  "volume,"  into  power  and  constancy;  while  for  such  a 
matter  as  "tone,"  it  might  be  necessary  even  to  burrow  into  the 
mysteries  of  harmonics. 

The  procedure  is  illustrated  in  Fig.  23.  It  can  be  seen  at 
once  that  such  a  classification  "matches  the  actual  process"  of 
marketing  radios  and  that  it  is,  therefore,  psychologically 
adequate. 
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It  is  impossible  to  lay  down  fixed  rules  for  each  detail  of  the 
entire  procedure.  Too  much  depends  necessarily  upon  the 
experience  and  skill  of  the  person  classifying  the  material.  In 
the  foregoing  example  the  classification  followed  the  order  of 
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of  fields  in  which  might  be  found 

methods  for  increasing  sales  of  radios 


Jst  STEP 

Methods  concerned  with 

the  company's 


PRODUCT    < 


2d  STEP 
With  respect  to 


APPEARANCE 


3d  STEP 
By  detailed  betterment 

of 
S 


4th  STEP 
From  point  of  view  of 


DESIGN 


MATERIAL 


[Size 
J  Color 
J  Shape 
[Style 

{Metal 
Wood 
Composition 


CRAFTSMANSHIP' 


Simple 
Ornamental 

J  Power 
[Constancy 


METHODS 


MEANS 


PERFORMANCE 


COST 


ADVERTISING 


SELLING 


SERVICE 


TONE 

FLEXIBILITY 

INITIAL 

OPERATING 

NEWSPAPERS 

MAGAZINES 

RADIO 

OUTDOOR 

WHOLESALERS 
RETAILERS 
CONSUMERS 


J  Range  of  wave  length 
lEase  of  handling 

J  Amount  involved 
1  Terms  of  payment 

J  Use  of  current 
^Repairs 

Local,  national 
Women's,  home,  farm 
Time,  spread 
Paint,  poster 

Chain,  independent 

Chain,  voluntary,  independent 


DELIVERY  

MAINTENANCE     

f  hen  would  follow  the  company's  MARKET  and  its  POLICIES — Both  similarly  divided  and  sub- 
divided into  their  smallest  considerable  components. 

Fig.  23. 

reason;  that  is  to  say,  the  analysis  was  not  predicated  on  a  sur- 
vey, but  only  on  what  is  known  of  the  fields  in  which  manufac- 
turers might  find  ways  to  promote  sales.  When  the  classification 
is  made  of  data  procured  in  an  actual  survey,  the  analyst's 
reasoning  is  greatly  aided  by  the  wealth  of  comment  coming  in 
from  a  multiplicity  of  sources.  Only  when  the  picture,  visualized 
in  its  different  parts,  matches  or  coincides  with  the  actual  situa- 
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tion  or  with  the  comments  and  answers  elicited  in  a  survey  can 
it  safely  be  said  that  the  classification  is  adequate  and  good. 

A  final  example,  including  the  actual  figures,  may  be  of  help 
to  anyone  who  tries  to  apply,  or  perhaps  to  teach,  this  bit  of 
technique.  It  is  being  treated  here  at  length  because  the  whole 
method  is  so  very  difficult  to  formulate  exactly  in  words  and  yet 
it  is  one  of  the  most  important  safeguards  against  psychological 
errors  in  market  research. 

In  a  certain  study  regarding  beer-drinking  habits,  the 
question  was  asked:  "What  is  important  to  you  in  good  beer?" 
In  the  replies,  about  120  different  attributes  of  good  beer  were 
mentioned!  This  question  immediately  arose:  As  a  method  of 
classification,  is  it  sufficient  merely  to  list  these  attributes  in  the 
order  of  their  frequency?  Such  a  proceeding  might  be  of  some 
value  to  the  copy  writer,  but  for  others  it  would  make  poor 
reading  and  do  little  toward  stimulating  further  thinking.  As 
has  been  pointed  out,  the  proper  procedure  would  be  to  visualize 
what  the  respondents  might  have  had  in  mind  when  they  specified 
their  requirements  regarding  beer.  They  know  that  it  is  first 
brewed,  then  brought  to  a  drinking  place  and  handled  somehow 
there;  then  it  is  consumed  and,  finally,  it  has  its  effect  upon  the 
drinker.  Thus  the  whole  process  through  which  beer  goes 
becomes  the  frame  of  reference;  the  several  phases,  just  men- 
tioned, into  which  this  process  can  be  divided  furnish  the  best 
groups  for  the  first  step  of  the  formal  classification. 

In  looking  over  the  many  thousands  of  answers  recorded  in 
the  interview  returns,  it  was  found  that  actually  every  respondent 
had  seen  beer  in  one  phase  or  another  of  this  process.  It  was 
only  on  the  basis  of  such  experience,  whatever  it  may  have  been, 
that  the  respondent  stated  his  special  preference.  Some  men- 
tioned that  they  wanted  a  high  percentage  of  malt  in  their  beer, 
apparently  viewing  it  under  the  phase  of  its  production.  Others 
brought  up  details  of  handling.  But  the  largest  group,  of  course, 
viewed  the  matter  in  the  phase  of  immediate  consumption.  On 
this  phase,  therefore,  the  second  step,  a  subclassification,  became 
advisable.  Again,  the  general  procedure  of  psychological 
analysis  is  followed.  If  "consumption"  is  the  preponderant 
interest,  what  suggestions  arise?  It  must  be  realized  at  once 
that,  in  consuming  beer,  all  of  the  senses  are  involved.  Imme- 
diately the  smell,   color,   taste,  temperature   are   distinguished 
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and  certain  touch  qualities — such  as  foam,  consistency  (thick 
or  thin)  and  so  on.  Based  on  these  sensible  distinctions,  the 
following  main  classification  clearly  results: 

Per  Cent 

Preparation •  •       6.2 

Handling 3.8 

Consumption 81.8 

Temperature 30 . 6 

Taste 29-3 

Touch  Attributes 16.6 

Color 3.5 

Smell 18 

Effect 8-2 


100.0 


It  is  not  surprising  that  " consumption' '  should  be  the  out- 
standing field  of  thought  in  these  answers;  but  it  is  interesting 
to  see  that,  among  the  several  aspects  of  consumption,  tempera- 
ture plays  such  an  important  role.  The  chief  value  of  this 
table,  however,  lies  not  in  itself  but  in  the  opportunity  it  presents 
now  to  analyze  the  different  classes  separately.  In  regard  to 
"effect,"  for  example,  the  following  grouping  gives  an  idea  of 
the  sort  of  answers  comprised  in  this  class : 

Per  Cent 

Should  not  have  bad  after  effects 53 

Specified  positive  requirements 44 

Should  be  stimulating 17 

Should  quench  thirst I4 

Should  be  nourishing 13 

Other  requirements 3 

100 

It  is  interesting  to  note  that  freedom  from  bad  effects  is  impor- 
tant to  more  people  than  are  the  positive  requirements.  Unfor- 
tunately, no  specifications  as  to  just  what  represents  bad  after 
effects  were  asked.  The  three  positive  groups,  however,  are 
significant  leads  for  the  manufacturer;  and  they  might  not  have 
been  brought  to  light  except  through  this  method  of  articulate 
and  adequate  classification. 

1  It  is  not  necessary  or  important  that  the  sum  of  the  figures  in  the  second 
step  should  equal  exactly  the  total  of  the  corresponding  head-class  or  that 
they  be  computed  on  a  basis  of  100  per  cent.  , 
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Requirement  3:  Logically  Correct;  Two  Traditional  Rules. 

Textbooks  of  logic  point  out  two  rules  which  hold  true  for 
every  classification.  They  might  be  put  into  the  following 
form: 

No  one  step  of  an  articulate  classification  should  ever  include 

a.  Groups  of  different  generality. 

b.  Groups  which  have  been  acquired  under  different  aspects 
of  classification. 

The  first  rule  is  very  evident  and  is  aptly  exemplified  by  the 
advice  against  speaking  simultaneously  of  "  flesh  and  fowl  and 
good  red  herring."  If  one  should  report  that  a  library  contains 
twelve  professional  papers,  eight  hobby  magazines,  five  fan 
magazines  and  two  detective  magazines — the  group  "fan  maga- 
zines' '  would  evidently  not  be  a  true,  adequate,  or  sensible 
group;  it  excludes  the  detective  magazines  which  are  as  truly 
"fan"  magazines  as  any. 

If  for  some  reason  it  is  necessary  especially  to  point  out  the 
two  detective  magazines,  they  should  be  specified  in  a  second 
step  of  the  classification  and  as  a  subdivision  of  the  major  group — 
"fan  magazines."  This  would  bring  the  two  detective  magazines 
positively  into  evidence  and  in  their  right  relationship  to  the 
whole  classification. 

The  second  rule  prohibits  such  a  report  as — "The  library 
contains  professional,  hobby,  and  illustrated  magazines."  This 
would  be  a  faulty  classification  because  it  might  very  well  be 
that  some  of  the  hobby  magazines  and  even  some  of  the  profes- 
sional ones  are  illustrated.  If  both  aspects  are  of  interest,  con- 
tent and  illustration,  two  classifications  are  clearly  indicated. 

Evident  as  these  rules  are,  they  are  constantly  being  over- 
looked. For  instance,  the  New  York  Police  Department  had 
an  announcement  in  the  subways  enumerating  the  chief  reasons 
for  automobile  accidents.  The  announcement  said  that  the 
three  major  types  of  accidents  in  which  the  driver  is  involved  are: 
Collision  of  vehicles,  skidding  of  automobiles  and  reckless  driving. 
It  is  not  admissible  to  coordinate  in  one  step  the  collision  of 
vehicles  and  reckless  driving  because  they  are  gained  under 
different  aspects. 

The  first  item  uses  as  its  aspect  the  objects  involved  in  the 
accidents.  Their  coordinated  groups  might  be  collisions  of 
vehicles  with  obstructions  in  the  street,  such  as  pillars;  collisions 
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of    vehicles    between    themselves;    collisions    of    vehicles    with 
pedestrians;  etc. 

The  last  item,  "  reckless  driving,"  uses  as  its  aspect  the  special 
Way  in  which  the  driver  behaved  just  before  the  accident.  The 
coordinated  groups  in  this  case  might  be  the  sudden  illness  of 
the  driver,  incompetent  driving,  irresponsible  disposition,  etc. 
Such  personal  circumstances  may  lead  to  many  special  forms  of 
accidents  and  for  that  reason  accidents  cannot  logically  be  differ- 
entiated by  considering  in  the  same  table  the  objects  involved 
and  the  driver's  fitness. 

Such  a  criticism  is  not  simply  academic;  it  has  a  positive  value. 
Suppose  it  be  necessary  to  decide  which  is  more  urgent — to 
improve  the  condition  of  the  streets  or  to  strengthen  the  enforce- 
ment of  traffic  regulations  upon  drivers.  The  decision  might 
depend  entirely  upon  a  study  of  the  reasons  for  accidents. 
Those  reasons  would  first  have  to  be  classified  correctly;  but, 
because  the  whole  group,  "  collisions,' '  might  be  due  just  as  well 
to  reckless  driving  as  to  bad  street  conditions  it  would  have  to 
be  determined  definitely  under  just  what  aspect  each  accident 
has  been  reported.  Only  then  could  the  classification  be  reason- 
ably undertaken. 

It  is  when  these  two  fundamental  rules  are  applied  to  the 
classification  of  questionnaire  returns  that  the  most  important 
point  in  these  deliberations  is  reached. 

Requirement  4 :  Psychologically  Pertinent,  Taking  into  Account 
the  Respondent.  Imagine  the  following  situation:  An  investiga- 
tor wants  to  classify  the  magazines  in  a  library,  but  he  has  not 
seen  them  himself.  Other  people  have  access  to  them  and  the 
investigator  asks  these  other  people  to  tell  him  about  the  maga- 
zines. This  leaves  it  entirely  with  the  respondents  to  select 
for  reference  what  they  want.  Some  will  tell  about  the  contents 
of  the  magazines,  some  about  their  format  and  others  about 
styles  of  printing  or  illustrations;  some  will  speak  in  general 
terms  about  fan  magazines  and  hobby  magazines  and  others  will 
mention  specific  names. 

In  such  a  situation,  it  will  not  be  possible  to  follow  immediately 
the  two  logical  rules  presented  in  the  foregoing  discussion. 
People  have  reported  under  a  number  of  different  aspects  and 
their  reports  must  be  handled  exactly  as  given.  One  cannot 
safely  violate  logical  rules.     There  is,  however,  one  way  out. 
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An  extra  step  of  classification  will  first  have  to  be  inserted — to 
separate  the  answers  according  to  the  aspect  and  the  level  of 
generality  under  which  they  are  given.  From  this  point  on,  all 
the  rules  can  safely  be  followed  in  the  subsequent  steps  for  each 
group  separately. 

To  keep  within  the  frame  of  the  library  example: 

The  first  step  is  to  distinguish  between  different  classes  of 
information  as  determined  by:  (a)  reference  to  content,  (6)  refer- 
ence to  typographical  features,  (c)  reference  to  the  literary  form 
of  the  articles,  and  so  on. 

In  the  second  step,  the  group  a — data  referring  to  content — 
might  be  subdivided  into  professional,  hobby  and  fan  magazines; 
group  b,  into  magazines  with  modern  or  obsolete  type  styles, 
light-faced  or  bold,  single  or  multiple  reading  columns,  and  so  on. 

Coming  to  the  third  step,  it  must  be  remembered  that  there 
cannot  be  coordinated  in  one  step  two  such  different  ideas  as 
general  information — "fan  magazines"  and  specific  titles — 
True  Detective.  Therefore,  in  the  third  step,  two  groups  must 
first  be  set  up — " Contents  specified"  and  "Contents  not  speci- 
fied." These  groups  will  then  permit  a  fourth  step  of  classifica- 
tion— "fan  magazines"  for  instance,  into  movie  magazines,  golf 
magazines,  detective  magazines,  etc. 

To  make  the  matter  entirely  clear,  two  concrete  examples  will 
be  given.  The  first  of  these  pertains  to  level  of  generality  and  the 
second,  to  aspect  of  classification. 

In  a  certain  study  dealers  were  asked  what  method  proved 
successful  in  increasing  the  sales  of  radio  sets.  The  answers 
which  pertained  to  advertising  were  first  classified  as  follows: 

Advertising  (attractive,  regular,  consistent) 233 

Local  newspaper  advertising 88 

National  magazine  advertising 42 

Effective  broadcasting 28 

The  X  radio  program 20 

The  Y  radio  program 2 

Total 413 

This  table  is  not  easily  or  clearly  to  be  construed.  There  is, 
for  instance,  one  huge  figure  to  be  compared  with  many  small  ones. 
If  it  is  desired  to  know  in  how  many  cases  the  X  radio  program 
was  successful,  it  cannot  be  assumed  that  20  is  correct;  many  of 
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the  people  who  gave  the  answer  " effective  broadcasting"  may- 
have  had  the  X  program  in  mind  but  confused  the  situation  by- 
replying  on  a  higher  level  of  generality.  Note  how  much  the 
table  is  improved  when  put  in  the  following  form*. 

Advertising  specified 180 

Broadcasting 50 

Specified . .  .22 

X  program 20 

Y  program 2 

Not  specified 28 

Magazines 42 

Newspaper 88 

Advertising  not  specified 233 

413  Total  references  to 
advertising 

In  this  presentation  the  different  levels  of  generality  are  clearly 
defined.  It  is  unfortunate  that  so  many  people  fail  to  specify 
the  advertisements  they  have  in  mind.  But  if  any  of  them  are 
explicit,  their  information  cannot  be  obscured  by  the  delinquen- 
cies of  others  when  the  whole  is  properly  classified.  By  this  same 
process  of  classification  the  three  advertising  media — broadcast- 
ing, magazines,  newspapers — are  put  on  a  comparable  basis. 
Then  is  discovered  the  interesting  detail  which  was  not  evident 
in  the  previous  table,  namely,  that  broadcasting  is  more  fre- 
quently mentioned  than  are  magazines.  Finally,  the  two  radio 
programs  can  be  compared— with  the  fact  borne  in  mind  that  a 
number  of  the  references  to  broadcasting  were  inexplicit  as  to 
program  and  that,  therefore,  such  a  comparison  must  be  regarded 
as  relative  only. 

Frequent  experience  has  shown  that  this  method  of  presenta- 
tion is  not  only  more  justifiable  scientifically,  but  that  a  client 
can  get  from  it  much  more  than  any  such  mere  enumeration  as 
the  first  table  could  give  him. 

This  will  become  especially  evident  from  the  second  example: 
In  Vienna  the  household  laundry  is  usually  washed  at  home.  It 
is  one  of  the  lowly  domestic  tasks  in  which  women  in  good 
circumstances  still  take  pride.     The  "wash,"  therefore,  is  seldom 
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sent  out.  A  certain  laundry  company  asked  several  hundred  of  its 
customers  why  they  sent  out  the  laundry,  in  order  to  ascertain 
from  their  replies,  if  possible,  how  other  women  could  be  induced 
to  do  the  same.     Among  the  answers  were  such  statements  as: 

"I  had  to  give  up  the  maid." 

"I  wanted  to  save  time." 

"I  took  a  job." 

"I  did  not  want  to  work  so  much." 

"I  became  ill,"  etc. 

It  would  have  been  possible,  of  course,  just  to  list  those  replies 
and  indicate  the  number  of  interviews  in  which  each  was  given; 
but  a  much  more  important  result  can  be  procured  by  following 
the  requirement  and  considering  the  aspects  under  which  those 
respondents  most  likely  saw  the  whole  problem.  Now  all  those 
customers  sent  out  the  laundry  for  some  advantage,  and  they 
all  decided  to  do  so  on  some  occasion  or  other.  The  general 
psychological  analysis  of  the  act  of  sending  out  the  laundry  shows 
that  these  two  aspects  of  it  are  indispensable:  a  general  purpose 
for  the  sake  of  which  the  housewife  wants  laundry  sent  out  and  a 
special  occasion  on  which  she  finally  makes  up  her  mind. 

In  looking  over  the  replies,  of  which  a  few  samples  are  shown 
above,  it  is  clear  that  some  of  the  respondents  answered  under  the 
aspect  of  occasion  and  others  under  the  aspect  of  advantage. 
Therefore,  the  first  step  is  to  distinguish  two  main  classes  corre- 
sponding to  those  two  aspects  and  then  to  divide  each  of  them  in 
turn  as  a  second  step.     In  this  way  the  following  table  is  derived : 

Per  Cent 

Occasions 81 

Gave  up  maid 30 

More  family  members  or  guests 19 

Housewife  took  a  job 18 

Housewife  became  ill  or  older 14 

Advantages 19 

Saves  time  and  work 13 

Is  cheaper 6 

100 

The  outstanding  disclosure  is  that  housewives  give  many  more 
answers  under  the  aspect  of  occasion  than  under  that  of  advan- 
tage.    This  seems  to  show  that  the  Viennese  woman  still  feels  it 
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her  duty  to  keep  the  laundry  at  home.  Apparently  it  is  only 
under  the  pressure  of  an  emergency  situation  that  she  sends  it  out. 
The  various  groups  in  the  second  step  of  the  classifications  indicate 
the  numerical  importance  of  the  different  emergencies.  More 
detailed  discussions  of  this  table  will  be  presented  in  the  course 
of  a  later  chapter  on  interpretation. 

Here  again  occur  the  first  three  "  requirements."  All  of  these 
classifications  are  articulate— in  that  they  proceed  in  different 
steps  of  grouping.  They  are  all  psychologically  adequate— in 
that,  by  following  the  process  underlying  the  act,  one  is  brought 
inescapably  to  distinguish  between  the  "purpose"  and  the  "occa- 
sion" of  sending  out  the  laundry.  The  classifications  also  tend 
to  be  logically  correct  because  they  present  no  confusion  as  to 
either  the  aspects  or  the  levels  of  generality.  But,  in  addition  to 
these  three  requirements,  a  fourth  one  had  to  be  fulfilled. 

It  is  now  possible  to  formulate  this  fourth  requirement  and  to 
consider  its  psychological  background.  A  question  cannot  of 
itself  determine  completely  the  aspect  under  which  an  object,  an 
incident  or  an  experience  should  be  viewed  by  the  respondent; 
neither  does  it  determine  fully  the  level  of  generality  on  which  he 
should  respond.  Therefore,  it  is  very  probable  that  in  most 
studies  the  returns  are  not  immediately  suitable  for  classification. 
They  have,  first,  to  be  separated  into  different  classes  according 
to  the  aspect  of  the  problem  which  impresses  each  respondent 
or  the  level  of  generality  on  which  he  replies  to  the  question. 
Only  within  these  classes  is  a  grouping  possible  which  also 
complies  with  the  three  other  requirements  of  classification. 

A  classification  which  fulfills  this  fourth  requirement  may  be 
called  " psychologically  pertinent."  It  actually  requires  a  two- 
fold psychological  effort.  First,  all  the  aspects  in  which  the 
matter  in  question  can  be  viewed  must  be  noted;  then,  each  single 
reply  must  be  individually  interpreted  in  order  to  determine  to 
which  aspect  it  refers  and  in  which  class  it  most  appropriately 
belongs.  In  accomplishing  this,  the  best  psychological  results  can 
be  reached  only  by  going  back  and  forth  between  the  psychologi- 
cal possibilities  inherent  in  the  structure  of  the  problem  and  the 
actual  psychological  implications  of  the  answers.  The  technique 
involved  here  is  somewhat  similar  to  that  used  in  making  a  classi- 
fication psychologically  adequate.  To  make  this  procedure  as 
clear  as  possible,  a  few  illustrative  problems  will  be  discussed. 
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How  to  Make  a  Classification  Psychologically  Pertinent.     The 

requirement  of  being  psychologically  pertinent  is  essential  to  the 
classification  of  questionnaire  returns.  The  reason  is  that  in 
questionnaire  returns  one  is  dealing  with  objects  only  indirectly. 
It  is  not  real  objects  or  events  that  are  classified;  it  is  only  remarks 
about  objects  and  events.  The  remarks  have  been  elicited  by  the 
question.  Now,  every  question  is  subject  to  a  certain  margin  of 
chance  as  to  how  the  respondent  will  understand  it.  The  group- 
ing of  the  uses  respondents  make  of  this  margin  of  chance  ought 
always  to  be  the  first  step  in  classifying  returns. 

Only  in  the  second  step,  then,  can  one  proceed  to  such  a  classi- 
fication as  would  represent  the  first  step — were  the  dealings 
directly  with  objects  and  not  simply  with  reports. 

To  a  certain  degree  the  questionnaire  can,  of  course,  influence 
the  margin  left  to  the  respondent.  If  the  question  is: — "What 
articles  do  you  like  best  in  Magazine  X,"  the  respondent  is  left  free 
to  understand  the  question  as  pertaining  either  to  form  or  to 
content.  It  might  be  asked:  "What  contents  of  articles  do  you 
like  best?"  Then  the  respondent  would  be  forced  to  answer 
under  the  aspect  of  content;  but  he  would  still  be  free  to  choose 
his  level  of  generality.  One  might  answer,  "Aviation";  another 
might  answer,  "Transatlantic  aviation." 

So  a  problem  arises  as  to  how  much  freedom  the  question  should 
leave  the  respondent  in  the  matter  of  choosing  how  he  wants  to 
understand  it.  Should  specifications  be  added  indefinitely  to 
every  question,  to  indicate  the  aspect  in  which  it  should  be  viewed 
and  the  level  of  generality  on  which  it  should  be  answered? 
There  are  definite  limits  to  that.  If,  for  practical  purposes, 
"aviation"  were  as  good  a  reply  as  "transatlantic  aviation," 
both  answers  could  be  lumped  together  in  the  classification  and 
no  special  question  would  be  needed  to  elicit  the  difference.  The 
margin  should  not  be  narrowed  beyond  practical  necessity.  It  is 
even  possible  in  some  cases  that  the  margin  should  be  large;  it 
might  be  very  revealing  and  instructive  as  to  the  different  ways 
in  which  respondents  may  understand  a  question. 

In  an  oil  study,  one  of  the  questions  was:  "What  is  important 
in  a  good  oil?"  Here  the  two  principal  aspects  presented  to 
respondents  for  choice  were :  the  purpose  the  oil  should  fulfill,  and 
the  feature  of  the  oil  by  which  its  ability  to  fulfill  its  purpose  could 
be  recognized.     Many  respondents,  for  instance,  considered  it 
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most  important  that  oil  should  not  freeze  too  soon.  Some  gave 
this  answer  straight,  as  it  is  put  here;  others  spoke  about  viscosity 
and  other  qualities,  implying  that  these  technical  features  effec- 
tively retard  freezing. 

In  the  study  mentioned,  the  replies  were  classified  in  accordance 
with  the  respondents'  choice  between  these  two  aspects.  For  the 
whole  group,  technical  features  were  mentioned  165  times  for 
every  100  times  the  explicit  purpose  was  mentioned.  A  further 
analysis  showed  that  this  ratio  was  definitely  dependent  upon  the 
price  of  the  car  the  respondent  owned.  Distinguishing  three 
groups  of  cars  according  to  their  prices,  there  was  found  the 
following  ratio  of  technical  " feature"  comments  for  every  100 
"purpose"  comments: 

Owners  of  low-priced  cars 171 

Owners  of  middle-priced  cars 195 

Owners  of  high-priced  cars 230 

This  table  shows  the  rough  grouping  to  be  significant,  in  that  it 
exhibits  marked  differences  between  the  owners  of  various  grades 
of  cars.  The  higher-priced  the  car,  the  more  specifically  con- 
cerned was  the  owner. 

This  example  is  very  similar  to  that  discussed  in  connection 
with  the  reasons  for  sending  out  laundry  (page  204).  In  the 
latter  example  two  questions  might  have  been  specified:  "For 
what  purpose"  and  "On  what  occasion"  did  you  send  out 
your  laundry?  It  happened,  however,  that  the  important  fact 
was  the  number  of  respondents  who  chose  the  aspect  of  "occa- 
sion" to  answer  the  general  question,  "Why?". 

In  other  cases,  the  question  might  leave  such  a  wide  margin 
that  the  returns  would  become  silly  or,  at  least,  inadequate  to 
the  purpose  of  the  study.  If  the  question  were:  "Where  have 
you  seen  this  advertisement?"  and  one  respondent  should  say, 
"in  my  dentist's  waiting  room,"  while  another  should  say, 
"In  the  Magazine  X,"  then  of  course,  the  margin  of  freedom  is 
manifestly  too  great.  It  might  be  felt,  perhaps,  that  so  bad  a 
slip  could  be  only  an  exception.  But  how  about  all  the  variations 
of  the  question,  "Why  do  you  buy  brand  X? "  Virtually  all  the 
possibilities  of  testing  the  effectiveness  of  advertising  by,  direct 
interview  have  been  neglected  because  research  men  have  not 
realized  that  the  margin  left  with  this  question  is  so  large  as  to 


208  THE  TECHNIQUE  OF  MARKETING  RESEARCH 

include  the  aspect  of  both  influence  and  attribute.  It  might  be 
well  to  refer  to  the  elaborate  discussion  of  this  topic,  beginning  on 
page  83,  in  Chap.  IV. 

In  general  it  is  left  to  the  skill  of  the  researcher  to  determine 
what  he  will  settle  through  the  wording  of  his  question  and  what 
he  will  leave  to  the  psychological  interpretation  of  the  replies. 
The  important  point  is  that  he  thoroughly  understand  the 
problem  involved.  He  must  realize  that  if,  deliberately  or  other- 
wise, he  has  left  his  respondents  a  considerable  margin  of  choice, 
he  must  make  doubly  sure  that  his  classification  is  psychologically 
pertinent.  He  must,  in  each  first  step,  refer  to  the  choice  of 
aspect  or  level  of  generality  which  each  respondent  has  made 
within  the  margin  left  to  him  by  the  question. 

Here  is  a  final  example,  to  show  how  to  decide  in  a  special  case 
which  aspect  is  implied  in  a  single  answer.  In  a  study  regarding 
fruit  juice,  housewives  were  asked  how  they  started  to  use  it. 
It  appeared  that  a  great  many  respondents  reported  that  some 
family  member  came  home,  told  about  the  new  juice  and  asked 
that  it  be  tried  out.  Therefore,  a  special  group,  "For  a  member 
of  the  family,"  was  introduced.  Then  a  member  of  the  research 
staff  found  this  reply:  "Bought  it  because  thought  it  would  be 
good  for  the  baby,"  and  that  answer  was  classified  as  belonging  to 
the  group,  "For  a  member  of  the  family."  Psychology  was 
apparently  ignored.  In  a  pertinent  and  articulate  classification 
there  should  be  a  main  class  pertaining  to  "influences"  and  in 
this  fruit-juice  case  a  special  group  should  have  been  introduced 
into  that  class  to  read  "For,  (or  better)  upon  the  request  of  a 
family  member."  Obviously,  the  baby  could  not  have  been  an 
influence  in  this  sense.  So,  there  should  also  have  been  another 
main  class  pertaining  to  "purposes."  Here  should  have  been 
grouped  all  of  those  answers  wherein  the  housewife  told  the 
purpose  for  which  she  bought  the  fruit  juice.  In  this  group 
would  have  been  the  psychological  place  for  the  baby.  The  fact 
that  it,  too,  is  a  member  of  the  family  does  not  make  less  errone- 
ous its  classification  in  the  former  group. 

Before  leaving  this  problem  of  psychologically  pertinent  classi- 
fication, it  seems  advisable  to  summarize  the  whole  idea  and  its 
value  in  one  more  example: 

Twelve  hundred  interviews  were  had  with  Pittsburgh  house- 
wives, discussing  with  each  the  reasons  for  her  last  purchase  of  a 
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dress.1  The  questions  of  the  interviewers  were  rather  thorough, 
so  that  the  1,200  respondents  gave  more  than  4,500  reasons. 
Quite  clearly,  these  respondents  viewed  the  purchase  in  different 
aspects.  A  schematic  psychological  analysis  showed,  however, 
that  most  of  the  reasons  pertained  to  the  following  three  aspects : 
A  specific  influence  which  brought  the  respondent  into  the  store 
(advertising,  advice,  etc.);  a  special  characteristic  of  the  store 
(the  style  it  offered,  the  service,  etc.) ;  or  incidental  reasons  which 
facilitated  the  decision  to  enter  a  special  store  (personal  connec- 
tions, convenient  location,  etc.). 

In  order  to  show  how  productive  a  good  classification  can  be, 
the  reasons  given  by  respondents  who  bought  in  department 
stores  might  be  compared  with  those  given  by  persons  who  bought 
in  small  specialty  dress  shops.  The  table  on  page  210  gives  a 
classification  for  the  main  reasons  in  two  steps— the  first  con- 
stituted according  to  the  three  main  aspects  of  reply  and  accord- 
ing to  Requirement  4;  with  the  second  made  up  of  the  several 
elements  or  subdivisions  of  the  first. 

There  is  a  wealth  of  information  to  be  gained  here.  The  first 
step  discloses  that  the  " incidental  reasons"  are  more  frequent 
with  the  department  store,  but  that  "specific  influences"  are 
more  frequent  with  the  small  shops.  Apparently,  housewives 
need  a  special  reason  to  go  to  a  small  shop  and  when  there  is  no 
such  reason  the  general  situation  favors  the  patronage  of  a 
department  store.  Among  "  specific  influences,"  the  department 
store  excels  through  advertising;  the  small  shop,  through  its 
window  displays.  Among  the  "incidental  reasons,"  the  personal 
connections  do  for  the  small  shop  very  much  what  a  charge 
account  does  for  the  department  store.  Even  the  meaning  of 
"convenient  location"  is  different  for  the  two  types  of  outlets. 
The  department  store  is  convenient  in  connection  with  other 
shopping,  while  the  small  shop  is  convenient  as  a  neighborhood 
facility.  From  the  "characteristics  of  the  store"  it  appears  that 
buying  in  small  shops  means  a  saving  in  price  at  a  sacrifice  in 
style. 

i  The  study  was  conducted  by  Dr.  David  R.  Craig,  then  (1934)  director 
of  the  Research  Bureau  for  Retail  Training,  of  the  University  of  Pittsburgh; 
the  results  have  been  embodied  in  a  mimeographed  pamphlet  under  the 
title,  "Acceptance  and  Rejection  of  Rayon,"  which  is  available  at  the 
University. 
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The  whole  table  gives  a  very  clear  psychological  picture.  The 
more  direct  contact  with  the  small  shop,  by  personal  connection 
and  window  display,  is  offset  by  the  department  store's  more 
impersonal  institutions  of  charge  accounts  and  advertising.  The 
department  store  offers  advantages  of  style,  which  seem  to  be 
conveyed  partly  by  the  advice  of  friends  and  partly  by  immediate 
temptation  to  the  customer  while  in  the  store.  A  more  thorough 
discussion  of  this  classification  would  show  that  the  words 
" convenient  location"  and  " charge  account"  are  each  susceptible 
of  several  meanings;  these  could  be  brought  to  light  by  " specify- 
ing" questions,  but  since  this  process  has  already  been  illus- 
trated, no  further  details  are  required  here. 


Classes  of  reasons 


Specific  influences 

Advertising 

Sales 

Window  displays 

Friend's  advice 

Incidental  reasons 

Personal  connections 

Charge  account 

Happened  to  be  in  store . 
Convenient  location 

Characteristics  of  the  store 

Style 

Size  and  fit 

Service 

Price 


Department 

stores, 

per  cent 


18     (100) 
20 
25 
17 
38 

32     (100) 

8 

15 

18 

59 

50     (100) 
48 
14 
20 
18 

100 


Small  shops, 
per  cent 


29     (100) 
4 
7 
62 

27 

21     (100) 

25 

5 

5 

65 

50     (100) 
38 
11 
23 

28 

100 


Psychological  Classification  and  Numerical  Results.  There 
are  two  final  ways  of  testing  a  classification.  The  first  test  is  the 
kind  and  degree  of  help  which  the  classification  gives  to  inter- 
pretation. This  test  will  be  covered  in  a  later  chapter.  The 
second  test  is  that  the  classifications  must  result  in  significant 
numerical  differences. 
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Every  classification  of  returns  is  crossed  with  related  variables. 
These  may  be,  for  instance,  age,  occupation  of  the  respondent, 
the  brands  he  uses  or  some  similar  simple  item.  If  the  classified 
distribution  of  returns  is  different  for  different  groups  of  respond- 
ents, it  should  be  regarded  as  satisfactory.  If  the  returns, 
distributed  according  to  the  prescribed  plan  of  classification, 
always  remain  alike — whatever  group  of  respondents  may  be 
taken — there  is  good  reason  to  suspect  the  classification.  This 
test  is  so  well  known  to  every  research  man  that  it  is  not  necessary 
to  discuss  it  in  any  detail.  However,  it  is  worth  while  to  point 
out  that  the  connection  between  numerical  results  and  psychologi- 
cal classification  also  works  the  other  way.  Numerical  differ- 
ences might  sometimes  be  used  in  order  to  come  to  a  sounder 
classification  of  psychological  importance. 

The  problem  itself  can  be  shown  in  a  very  primitive  way. 
Suppose  it  were  desired  to  know  if  there  is  a  difference  between 
young  and  old  people  in  using  the  various  brands  of  a  certain 
commodity.  A  comparative  tabulation  is  drawn  up  and,  if  the 
number  of  cases  is  limited,  a  point  in  years  is  chosen  to  distinguish 
between  young  and  old  people  and  to  establish  only  two  age 
classes.  The  age  line  may  be  drawn  at  thirty  or  thirty-five  years. 
It  is  perfectly  justifiable  to  set  the  limiting  age  at  a  low  figure 
so  that  the  differences  in  use  of  brand  between  the  two  age  groups 
may  become  as  large  and  as  clearly  marked  as  possible.  As  a 
matter  of  practice,  it  is  probable  that  one  age  group  would  be 
provided  for  persons  up  to  twenty-five  years  of  age ;  then,  perhaps, 
three  groups  for  persons  between  twenty-five  and  forty  and  one 
further  group  for  those  beyond  forty.  The  point  is  that  the 
line  may  be  drawn  in  any  way  that  seems  to  be,  statistically, 
most  spectacular. 

The  following  is  a  somewhat  complex  example  in  which  this, 
procedure  led  to  some  very  useful  results.  This  case  also  concerns 
a  fruit  juice,  which  was  under  investigation  in  a  nation-wide 
study.  The  special  question  read:  "How  did  you  start  to  use 
your  brand?"  For  the  report,  the  brands  A  and  B  were  to  be 
compared.  In  the  original  returns,  about  forty  different  groups 
of  reasons  were  found— making  the  table  difficult  to  survey  and 
even  more  difficult  to  interpret.  It  was  decided,  therefore,  to 
put  together  all  of  the  reasons  which  were  given  with  the  same 
frequency  for  both  brands.     Since  these  offset  each  other,  they 
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were  of  no  importance  for  the  purpose  of  comparison.  Then  those 
reasons  in  which  A  brand  was  stronger  were  put  together  and, 
finally,  those  in  which  B  brand  was  stronger.  Here  is  the  table 
that  resulted: 


A  stronger  than  B : 

Familiarity  with  the  brand  name . 

Store  display 

B  stronger  than  A : 

Other  advertisements 

Recommendation  by  friends 


B 


26.0 

13.3 

16.7 

12.5 

8.0 

20.4 

2.3 

7.1 

The  first  two  classes  are  psychologically  highly  significant. 
Apparently,  brand  A  had  a  well-established  reputation  (actually, 
the  name  of  this  brand  appears  on  many  other  foods) .  Brand  B 
was  making  its  progress  by  strong  and  apparently  successful 
advertising.  Very  interesting  is  the  role  of  dealers  and  friends. 
The  dealers,  in  a  small  majority,  seemed  still  to  adhere  to  the  old 
brand — at  least,  in  the  matter  of  store  displays.  Friends,  on 
the  other  hand,  when  they  did  recommend,  talked  more  about  the 
brand  which  was  pushing  ahead.  From  the  point  of  view  of 
management,  this  comparison  was  highly  illuminating  for  both 
manufacturers. 

Classification  by  Types.  The  discussion  so  far  has  been  largely 
about  the  classification  of  the  returns  on  one  single  question.  A 
last  word  should  be  said  about  classifying  the  replies  to  several 
answers  at  the  same  time.  In  a  study  regarding  the  purchase  of 
pull-over  sweaters,  a  series  of  questions  made  it  possible  to  check 
whether  the  customer  had  decided  beforehand  which  store  he 
would  patronize  or  whether  he  just  came  upon  it  during  his 
shopping.  Calling  the  former  "directed  purchases"  and  the 
latter  "  non-directed,"  it  was  found  that  as  against  100  non- 
directed  purchases,  435  directed  ones  were  made.  But  breaking 
down  the  figures  according  to  the  store  where  the  purchase  was 
finally  executed,  it  was  found  that,  for  every  10  nondirected 
purchases,  the  following  number  of  directed  purchases  occurred: 

Store  X 77 

Store  Y 48 

Store  Z  (client) 22 
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Those  were  marked  differences.  Store  Z  was  taken  into  con- 
sideration in  advance  of  purchase  less  often  than  either  of  the 
other  stores.  This  reflection,  conjoined  with  other  corroborative 
information,  led  clearly  to  the  conclusion  that  Store  Z  was  not 
what  might  be  called  a  " branded"  store. 

Here  the  idea  was  to  distinguish  the  different  types  of  pur- 
chases. A  great  many  answers  were  considered  in  deciding  the 
type  to  which  each  respondent  belonged.  This  sort  of  classifica- 
tion gives  the  editor  a  greater  degree  of  freedom  and  it  sometimes 
proves  very  productive.  In  a  magazine  study,  for  instance,  the 
different  groups  of  readers  may  be  distinguished  according,  first, 
to  the  amount  of  interest  they  declare  in  the  magazine  and,  second, 
to  the  amount  of  interest  to  be  inferred  from  their  replies  to  various 
questions  asked  in  different  parts  of  the  interview.  If  it  is 
desired  to  establish  a  third  distinction,  several  questions  might 
be  asked  to  find  out  if  the  respondent  influences  purchases  at 
home,  if  he  has  a  vote  in  the  purchases  of  his  firm,  if  he  is  con- 
sulted by  his  friends — and  so  on. 

Again,  these  various  questions  might  be  combined  into  one 
index  characterizing  the  respondent's  importance  as  a  purchasing 
entity.  This  method  of  dealing  with  greater  parts  of  a  question- 
naire as  one  statistical  unit  is  susceptible  of  considerable  develop- 
ment and  is  likely  to  become  of  major  importance  in  future 
market  research. 


X 


J I 


J I 


J I 


J I 


CHAPTER  XII 
ORGANIZATION  OF  DATA 

(As  Presented  in  Chart  G) 

As  has  been  shown  in  the  foregoing  chapter,  the  effectiveness 
of  every  marketing  study,  the  value  of  its  conclusions  and  the 
clarity,  force  and  convincingness  of  the  final  report  rest  largely 
upon  a  comprehensive  and  sound  classification  of  the  assembled 
facts.  It  might  even  be  said  that  without  such  proper  classifica- 
tion there  can  be  no  study.  All  the  facts  in  the  world,  however 
competently  collected,  are  of  no  avail  unless  they  are  brought 
into  such  relations  to  one  another  as  will  illumine  the  problem 
under  study  and  lead  logically  to  its  solution.  It  is  only  when 
these  relationships  are  established,  by  organization,  that  the 
real  study  can  begin. 

It  is  for  this  reason  that  in  the  preceding  steps,  in  analyzing 
the  problem,  in  planning  the  procedure  and  in  collecting  the 
material,  the  idea  and  the  plan  of  organizing  the  data  should 
have  been  held  constantly  in  mind.  This  forethought  is  neces- 
sary to  the  end  that  all  the  significant  data  may  be  found,  that 
no  pertinent  point  may  escape  consideration  and  that  no  relation- 
ship may  remain  undisclosed  or  unexplored. 

In  large  investigations  it  is  probable  that  the  material,  as 
collected,  will  fall  naturally  into  some  broad  and  primary  classi- 
fications. These  correspond  with  the  "first  step"  described 
in  the  psychological  classification  discussed  in  the  preceding 
chapter.  Assume,  for  instance,  that  the  data  were  drawn  from 
manufacturer,  wholesaler,  retailer  or  consumer  sources,  or  from 
certain  geographical  areas  or  from  distinctive  social  or  racial 
groups.  Even  during  the  process  of  collection,  these  basic 
divisions  would  establish  themselves  almost  naturally  and,  as  a 
matter  of  expediency,  would  probably  be  maintained  in  practice 
throughout  the  entire  work. 

To  illustrate:  In  the  study  of  the  advertising  influence  of 
newspapers,  previously  referred  to,  it  must  have  been  apparent 
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at  the  very  inception  of  the  study,  that,  as  an  index  of  buying 
power,  the  income  levels  of  the  various  sections  of  the  city  would 
be  important.  A  heavy  circulation  among  ' '  the  great  unwashed ' ' 
has  little  real  value.  All  newspapers  have  some  of  this  circulation 
but  the  question  is  how  much?  So,  at  the  very  beginning,  the 
whole  city  was  considered  by  sections  in  the  order  of  the  people's 
income — as  that  income  was  inferred  from  the  value  of  the  home 
or  the  rent  paid  for  it. 

Income  groups,  then,  become  the  natural  division  for  the  first 
step  in  such  a  classification,  but  for  comparative  purposes  many 
similar  things  must  be  known  about  each  group.  One  must 
know  how  many  families  there  are  on  each  income  level;  how 
many  of  each  nationality  or  race;  how  many  use  each  paper;  how 
many  recognize  the  influence  of  either  paper;  and  a  number  of 
other  facts.  All  these  points  were  incorporated,  of  course,  in 
the  original  questionnaire  and  some  thousands  of  these  were 
completed.  They  were  then  ready  for  organization  and  study— 
and  they  had  to  be  studied  on  each  question  as  to  its  relation  to 
each  income  group. 

If,  for  any  reason,  the  material  as  presented  for  organization  is 
not  naturally  so  distinguishable,  an  initial  distribution  represents 
the  step  immediately  necessary.  A  classification  has  to  be  made 
on  the  principles  already  described.  The  result  of  this  might  be 
termed  a  "  preliminary "  organization  of  the  data.  That  first 
step  in  such  a  tentative  arrangement  will  not,  of  itself,  collate 
all  the  material;  it  might  not  eliminate  or  even  reveal  the  almost 
inevitable  duplication  of  data  or  ideas;  but,  in  a  large  study,  it 
represents  the  first  movement  toward  bringing  the  hundreds  or 
thousands  of  completed  questionnaires  into  some  semblance  of 
order.  This  primary  classification  must  precede  any  attempt  at 
detailed  organization.  It  presents  the  study  to  view  in  its 
major  masses  and  usually  suggests  the  pattern  by  which  the 
material  is  to  be  set  up  for  further  study. 

Although  the  procedure  for  organizing  data  has  been  broken 
down  into  five  equally  important  steps,  they  cannot  be  com- 
pletely segregated.  There  is  necessarily  some  overlapping 
between  the  steps  and  it  is  likely,  too,  that  in  arriving  at  the 
"  preliminary "  organization  some  of  the  factors  in  each  of  the 
five  major  steps  must  have  been  employed,  and  in  very  much 
the  same  sequence  as  they  may  occur  in  the  final  organization. 
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Examine  Collected  Data 
In  planning  a  study  and  in  the  actual  collection  of  data, 
reasonable  care  must  have  been  exercised  in  procuring  precisely 
the  material  required.  It  is  probable,  however,  that  when  the 
resulting  mass  of  information,  in  the  shape  of,  perhaps,  thousands 
of  completed  questionnaires,  has  been  made  ready  for  organiza- 
tion, the  types  of  data  and  their  relationships  will  show  varying 
degrees  of  utility.  Some  process  of  selection  must,  therefore,  be 
instituted.  The  material  must  be  examined  as  to  several  impor- 
tant aspects. 

As  to  Relevance.  It  may  be  said,  of  course,  that  if  the  ques- 
tionnaire were  properly  prepared  and  handled  and  if  the  editing 
were  carefully  done,  all  the  resulting  material  should  be  relevant. 
In  some  measure  the  specific  replies  to  questions  on  the  schedule 
usually  are.  Special  care  is  necessary,  however,  that  incidental 
information,  qualitative  data  and  abstract  reactions— prefer- 
ences, opinions,  desires— which  may  also  be  brought  in  from  the 
field  by  the  staff  be  evaluated  as  to  their  bearing  on  the  problem. 
All  of  this  material  may  have  some  degree  of  relevancy  but  some 
of  it  should  be  subordinated  to  data  of  graver  importance  and 
some,  entirely  eliminated. 

As  to  Reliability.  In  discussing  the  planning  of  the  study, 
again  in  connection  with  the  collection  of  data  and  elsewhere, 
certain  tests  have  been  referred  to.  It  is  too  late  now  to  institute 
tests;  all  the  facts  have  already  been  assembled.  The  point 
at  this  juncture  is  rather  to  determine  whether  or  not  the  tests 
which  were  applied  at  various  steps  during  the  phase  of  collecting 
data  are  adequate  to  assure  the  complete  dependability  of  the 
finished  work. 

This  present  examination  refers  not  only  to  tests  in  the  field, 
as  to  the  rightness  of  the  plan,  the  effectiveness  of  the  question- 
naire and  the  integrity  of  the  workers,  but  also  to  tests  of  the 
credibility  of  quoted  authorities,  of  conclusions  drawn  from 
bibliographical  sources  and  of  any  indices  that  may  have 
been  employed  for  comparative  purposes.  At  this  stage,  the 
consideration  of  reliability  is  more  or  less  a  safety  factor, 
an  extra  assurance,  that  no  data,  creeping  in  from  unreliable 
sources,  can  adversely  affect  the  soundness  and  the  truth  of  the 
study. 
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Where  there  is  the  slightest  question  regarding  the  reliability 
of  any  information  or  the  adequacy  or  integrity  of  any  of  the 
applied  tests,  any  section  of  the  study  which  may  be  affected 
must  either  be  discarded  outright  or  followed  through  further 
for  verification. 

As  to  Practicability.  It  is  conceivable  that  some  of  the  data, 
while  relevant  to  the  study  and  completely  reliable,  would  still 
have  little  practical  value.  The  criteria  of  practicability  with 
respect  to  data  are  their  pertinence  to  the  objectives  of  the  study, 
their  adaptability  to  presentation  and  their  power  to  convince. 

In  planning  a  study  and  in  conducting  the  field  work,  it  is 
imperative  that  no  sources  be  overlooked  which  might  yield  any 
light  on  the  subject  under  study.  But,  to  use  all  the  assembled 
material,  even  though  factual,  might  so  becloud  the  issue  as  to 
destroy  the  utility  of  the  result.  Since  research  is  expected  to 
lead  to  clear-cut,  definite,  positive  conclusions,  preference  must 
be  given  to  such  data  as  will  most  easily,  most  truthfully  and 
most  convincingly  support  that  expectation. 

Classify  and  Arrange 

This  phase  of  the  organization  of  data  may  be  approached  from 
many  different  angles,  according  to  the  particular  requirements 
of  each  situation,  but  in  all  cases  the  now  imminent  operation  of 
analyzing  the  data  must  be  kept  well  in  mind.  As  an  aid  to  such 
analysis  it  is  frequently  helpful  to  prepare,  at  this  stage  of  a 
study,  a  tentative  outline  of  the  subject  matter  in  the  order  in 
which  the  material  is  likely  to  appear  in  the  final  written  report 
and,  if  possible,  under  the  same  headings  and  subheadings. 

There  are  no  set  rules  for  the  preparation  of  such  a  preliminary 
outline,  except  that  the  more  complete  it  can  be  made,  the  better. 
The  sequence  in  which  the  various  factors  should  be  handled 
depends  upon  their  importance,  the  objectives  of  the  research 
and  the  personal  judgment  and  experience  of  the  director.  Such 
an  outline  should  be  prepared  first  on  loose  sheets,  a  sheet  for 
each  subject,  and  then  arranged  in  the  order  which  appears  most 
logical  with  respect  to  the  objectives;  additional  sheets,  covering 
other  ramifications,  can#then  be  inserted  as  needed  to  bring  the 
report  to  finished  form. 

An  outline  of  that  sort  may  grow  to  be  quite  extensive.  But 
brevity  has  no  place  here.     A  preliminary  outline  must  be  com- 
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prehensive;  it  must  be  thorough;  it  must  effectively  serve  to  focus 
the  mind  on  every  conceivable  aspect  of  the  subject  being  studied. 
And,  naturally,  the  questionnaire  is  itself  the  basis  on  which  any 
tentative  outline  logically  rests  because,  in  essence,  the  same 
purposes  must  have  influenced  the  original  intent  and  phrasing  of 
all  the  questions. 

An  example  of  such  a  typical  outline,  for  the  organization  of 
an  extensive  field  survey,  appears  on  this  page.  In  this  survey 
the  obvious  purposes  were  to  study  the  commercial  field  as  to  all 
the  factors  affecting  distribution  of  the  various  instruments 
through  stores ;  to  study  the  industrial  field  as  to  the  factors  affect- 
ing distribution  for  industrial  uses;  and,  finally,  to  study  the  com- 
pany's current  sales  and  territorial  breakdown.  Actually,  this 
study  comprised  three  distinct  surveys  and  it  is  interesting  to  see 
how  meticulously  the  details  have  been  thought  out  and  organized 
into  these  outlines. 

Typical  Outline  for  a  Five-volume  Report  of  a  Large  Field  Survey 
Volume  I.       Complete  summary  and  recommendations. 
Volume    II.  Summary  of  commercial-field  survey. 

Introduction. 

Section  1 — Field  covered. 

Section  2 — Temperature  thermometers. 

Section  3 — Clinical  thermometers. 

Section  4 — Barometers. 

Section  5 — Sphygmomanometers. 

Section  6 — Merchandising  and  general. 

Section  7— Methods  employed  in  conducting  survey. 
Volume  III.  Statistical  details  of  commercial-field  survey. 

(In  this  volume  were  presented  the  specific  data  to  support 
the  summary  in  Volume  II;  and  the  same  structural  arrange- 
ment was  Used  to  facilitate  references  between  the  two 
volumes.) 

Introduction 

Section  1 — Field  covered. 

Section  2 — Temperature  thermometers. 

Section  3 — Clinical  thermometers. 

Section  4 — Barometers. 

Section  5 — Sphygmomanometers. 

Section  6 — Merchandising  and  general. 

Section  7— Statistical  methods  employed. 
Volume  IV.    Report  on  industrial-field  survey. 

Introduction.  • 

Section  1— Plant  equipment  and  value. 

Section  2 — Last  purchase. 
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Section  3 — Buying. 
Section  4 — Plant  interviews. 
Volume     V.  Study  of  sales  and  territorial  analysis. 

Since  the  purpose  here  is  to  demonstrate  the  degree  of  particu- 
larity which  should  be  achieved  in  a  tentative  outline  of  this  sort, 
a  further  development  of  Volume  II,  showing  the  factors  covered 
and  the  order  in  which  they  were  handled  under  each  section,  is 
also  presented. 

This  outline  is  reproduced  from  an  actual  investigation.  Obvi- 
ously, reference  to  the  name  of  the  manufacturer  is  omitted. 
Many  of  the  items  are  listed  in  question  form  for  brevity  and 
clearness. 

Detail  of  Volume  II 

Introduction. 

Section  1.     Field  covered. 

Number  of  consumer  interviews. 

Address — city  and  state. 

Grade  of  home. 

Sex. 

Number  in  family. 

Children  in  family. 

Number  of  dealer  interviews. 

Address — city  and  state. 

Kind  of  outlet. 

Grade  of  outlet. 

Business  location. 

Position  of  person  interviewed. 

Number  of  surgical  dealer  interviews. 
Address — city  and  state. 
Number  of  detail  men  employed. 
Position  of  person  interviewed. 

Number  of  jobbers  interviewed. 
Address — cit3^  and  state. 
Kind  of  jobber. 

Number  of  salesmen  employed. 
Position  of  person  interviewed. 

Number  of  doctors  interviewed. 
Address — city  and  state.        ', 
•  Status  of  doctors. 
Number  of  years  in  practice. 
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Number  of  hospitals  interviewed. 
Address — city  and  state. 
Kind  of  institution. 
Number  of  beds. 
Number  of  nurses. 

Number  of  resident  doctors  and  internes. 
Section  2.     Temperature  thermometers. 
Consumers. 

Ownership. 

Number  by  type  owned. 

Types  owned. 

Total  owned. 

Makes  owned. 
Use  of: 

Inside — outside. 

In  what  rooms. 

Combination  use. 

Use  for  thermostatic  control. 
Retail  dealers. 

Consumer  factors  leading  to  purchase. 

Consumer  demand  for  both  indoor  and  outdoor  use. 

Can  thermometer  designed  only  for  indoor  use  be  successfully  sold. 
Consumers. 

History  of  last  purchase. 

Date  of  last  purchase. 

Type  last  purchased. 

Make  purchased  last. 

Why  was  this  make  selected. 

Most  important  factors  looked  for  in  thermometer  purchase. 
Retail  dealers. 

What  does  dealer  believe  are  outstanding  factors  in  consumer's  mind 
when  making  thermometer  purchase. 
Consumers. 

At  what  kind  of  a  store  was  last  thermometer  purchased. 

To  what  kind  of  a  store  would  you  go  to  purchase  a  new  thermometer 
(Owners). 

To  what  kind  of  a  store  would  you  go  to  purchase  a  thermometer 
(Nonowners). 

How  much  was  paid  for  last  thermometer  purchased. 
Retail  dealers. 

What  is  the  most  popular  selling  price  on: 

a.  Window  thermometers. 

b.  Indoor  thermometers. 

c.  Standing  thermometers. 

d.  Oven  thermometers. 

e.  Bath  thermometers. 
Consumers. 

Knowledge  of  thermometer  range,  indoor  vs.  outdoor. 
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Make  of  thermometer  considered  most  accurate. 
Knowledge  of  names  of  manufacturers. 
Knowledge  of  "Blank"  thermometer  company. 
Knowledge  of  "Blank"  thermometer. 
Retail  dealers. 

Call  for  thermometers  by  manufacturer's  name. 
Sex  of  persons  purchasing  most  thermometers. 
Consumers. 

Member  of  family  most  interested  in  weather  temperatures. 
Interest  in  newspaper  weather  news  and  forecasts. 
Methods  used  for  humidifying  home. 
Compass  ownership. 
Retail  dealers. 
Stock  carried. 
Types  carried. 
Biggest  selling  type. 
Makes  carried. 

Biggest  selling  makes  according  to  type. 
"Blank  and  Company"  line  stocked. 
Approx.  total  retail  sales  by  types. 
Trend  in  sales  past  year. 

"Blank  and  Company"  proportion  of  total  sales. 
Retail  dealers  (Not  handling  thermometers). 
Ever  handled  in  past. 
If  yes,  why  discontinued. 
If  no,  why  not  handled. 
Manufacturer  solicitation  of  dealer. 
Are  thermometers  a  profitable  fine  to  handle. 
If  no,  why  not. 
Jobbers. 

Types  of  thermometers  handled. 
Makes  handled. 
Jobber's  leading  make. 
Why  make  named  is  leader. 
Jobber's  total  annual  sales. 
What  percentage  "Blank  Company's"  line. 
Section  3.     Clinical  thermometers. 
Consumers. 

Number  owned. 
Type  owned. 
If  none  owned,  why. 
Has  family  ever  owned. 
If  yes,  why  not  now. 
If  no,  why  never  owned. 
Doctors. 

Attitude  toward  patient  ownership. 
Percentage  of  patients  owning. 
Extent  patients  report  temperatures. 
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Patients  that  ask  doctor  to  recommend  use. 
Make  doctors  recommend. 
Number  of  thermometers  owned. 

a.  Rectal. 

b.  Oral. 

Doctor's  opinion  of  one-minute  type. 
Surgical  supply  dealers. 

Opinion  on  elimination  of  all  but  the  one-minute  type. 
Doctors. 

Doctors  use  of  various  types. 

Use  of,  adults  vs.  children. 

Date  of  last  purchase. 

Make  last  purchased. 

Why  this  make  was  selected. 

From  what  kind  of  dealer  purchased. 

Same  make  previously  owned. 

If  no,  what  make  previously  owned. 

What  was  paid  for  last  thermometer. 
Retail  dealers. 

Name  of  best  selling  make. 

Is  " Blank  and  Company"  make  handled. 

Price  range  carried. 

Best  selling  price. 

Proportion  sold  to  doctors,  nurses,  consumers. 

Seasonal  sales. 
Surgical  supply  dealers. 

Makes  of  clinical  thermometers  handled. 

Biggest  selling  make. 

Reasons  for  make  named  being  best  seller. 

Extent  doctors  and  nurses  purchase  by  brand  names. 

Division  of  sales,  doctors — nurses — institutions. 

High  and  low  price  range  oral  thermometers. 

Most  popular  price. 

Sales  efforts  on  clinical  thermometers. 

Trend  toward  bulb  type. 

Market  for  thermometer  cases. 

Prices  doctors  pay  for  cases. 

Manufacturer  most  satisfactory  to  deal  with. 

Reasons  for  above. 

Dealers'  annual  sales  of  clinical  thermometers. 

What  per  cent  of  total  are  "Blank  and  Company"  instruments. 
Jobbers. 

Types  of  clinical  thermometers  handled. 

Makes  carried. 

Biggest  selling  make. 

Reasons  make  named  is  best  selling  line. 

Total  small  thermometer  sales. 

What  per  cent  of  total  are  " Blank  and  Company"  instruments. 
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Hospitals. 

Number   of   clinical   thermometers   purchased   past   year:    a.  Oral, 

b.  Rectal. 
Source  of  thermometer  purchases. 
Factors  determining  selection  of  make  purchased. 
Section  4.  Barometers. 
Consumers. 

Number  of  barometers  owned. 
Makes  owned. 
Source  of  possession. 
Where  kept:  inside — outside. 
Location  in  house. 
Opinion  of  accurate  forecasting. 
Frequency  of  consulting. 
Member  of  family  most  interested. 
Retail  dealers. 

Types  of  barometers  handled. 
Makes  handled. 
Biggest  selling  make. 
''Blank  and  Company"  line  handled. 
If  not,  why  not. 
If  yes,  in  what  price  ranges. 
Best  selling  price  range. 
Total  barometer  sales  past  year. 
Trend  in  sales. 

Proportion  of  sales  "Blank  and  Company's"  instruments. 
Jobbers. 

Types  of  barometers  handled. 
Makes  handled. 
Jobber's  leading  make. 
Why  make  named  is  leader. 
Annual  barometer  sales. 

Proportion  of  sales  " Blank  and  Company's"  instruments. 
Profit  in  barometer  line. 
Section  5.  Sphygmomanometers. 
Doctors. 

Number  owned;  a.  Mercurial,  b.  Aneroid. 

If  both  types  owned,  why. 

Type  preferred  by  doctor. 

Why  type  is  preferred. 

Influences  causing  preference  for  certain  type. 

If  both  owned,  which  type  usually  used  a.  For  office  use,  b.  For 

house  visits. 
Use  of  sphygmomanometers. 

a.  Systolic  and  diastolic  pressures. 

b.  Wave  pulse,  rhythm,  amplitude,  etc. 

Need  for  automatic  registering  blood  pressure  instrument. 
Price  doctor  would  be  willing  to  pay  for  same. 
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If  " Blank  and  Company"  sphyg.  owned,  is  he  satisfied. 
If  "Blank"  sphyg.  formerly  owned  why  was  it  discarded. 
When  was  last  sphygmomanometer  purchased. 
What  make  was  purchased  last  time. 
Why  was  this  make  decided  upon. 
If  buying  another  would  same  make  be  purchased. 
If  no,  why  not. 
If  yes,  why. 

From  what  kind  of  dealer  was  last  make  purchased. 
What  did  it  cost. 
Surgical  supply  dealers. 

Types  of  sphygmomanometers  carried. 

Biggest  selling  type. 

Makes  carried. 

Biggest  selling  make. 

Why  make  named  is  best  seller. 

Trend  in  use  by  types,  a.  Aneroid,  b.  Mercurial. 

Type  dealer  prefers  to  sell. 

Why  type  named  is  preferred  by  dealer. 

Extent  doctors  ask  for  sphygmomanometers  by 

a.  Maker's  name. 

b.  By  type. 

Factors  prompting  doctors  to  buy  new  instrument. 

Type  sphyg.  young  doctors  usually  ask  for. 

Doctor's  opinion  on  black-finish  instruments. 

Efforts  of  dealers  in  selling  sphygmomanometers. 

Sphygmomanometer  manufacturer  considered  most  satisfactory  to 
deal  with. 

Why  firm  named  is  most  satisfactory. 

Number  of  sphygs.  sold  past  twelve  months. 

What  per  cent  of  total  sales  were  "Blank  and  Company's"  instru- 
ments. 
Hospitals. 

Number  of  sphygmomanometers  in  use. 
a.  Mercurial. 
6.  Aneroid. 

Outstanding  factors  that  determine  selection  of  make  used. 
Section  6.  Merchandising  and  general. 
Retail  dealers. 

Element  of  style  as  a  factor  in  sale  of  temperature  instruments. 

Influence  of  extreme  weather  on  sale. 

Season  most  thermometers  are  sold. 

Dealers'  activities  during  year,  advertising,  special  sales,  displays. 
Jobbers. 

Jobbers'  activities  to  stimulate  sales. 
Retail  dealers. 

Source  of  principal  purchases. 

Attitude  toward  buying  through  jobbers. 
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Opinion  as  to  which  manufacturer  is  most  satisfactory  to  deal  with. 
Reasons  for  naming  certain  manufacturer. 
Jobbers. 

Opinion  as  to  which  manufacturer  is  most  satisfactory  to  deal  with. 
Reasons  for  naming  certain  manufacturer. 

Satisfaction  of  jobber  with  his  dealings  with  "Blank  and  Company." 
If  dealings  unsatisfactory,  why. 
Retail  dealers. 

Satisfaction  with  dealings  with  "Blank  and  Company." 
If  dealings  unsatisfactory,  why. 

Satisfaction  with  profits  in  thermometer  and  barometer  business. 
Jobber. 

Satisfaction  with  profits  in  thermometer  and  barometer  business. 
Retail  dealers. 

Frequency  of  "Blank  and  Company's"  salesman  calls. 

Frequency  of  other  manufacturers'  calls. 

Inquiry  on  special  deals  and  special  discounts  by  other  manufacturers 

for  purchases  of  grouped  merchandise. 
If  yes,  what. 
If  dealer  does  not  handle  "Blank  and  Company's"  instruments,  why 

not. 
If  dealer  formerly  handled  "Blank  and  Company's"  instruments, 
why  were  they  discontinued. 
Jobbers. 

If  jobber  doesn't  handle  "Blank  and  Company's"  line,  why  not. 
If  jobber  formerly  handled  "Blank  and  Company's"  line,  why  was  it 
discontinued. 
Surgical  supply  dealers. 

If  dealer  doesn't  handle  "Blank  and  Company's"  line,  why  not. 
If  dealer  formerly  handled  "Blank  and  Company's"  line,  why  was  it 
discontinued. 
Doctors. 

How  does  doctor  regard  "Blank  and  Company's"  products. 

How  do  "Blank  and  Company's"  instruments  compare  with  those 

trade  marked . — 

Surgical  supply  dealers. 

Have  dealer's  dealings  with  "Blank  and  Company"  been  satisfactory. 
If  no,  why  not. 
Section  7.     Methods  used  in  conducting  survey. 

(Here  followed,  of  course,  a  detailed  account  of  the  procedure.) 

This  voluminous  list  indicates  the  length  to  which  a  large  and 
competent  research  agency  will  go  to  assure  itself  against  the 
omission  of  any  significant  feature  or  fact.  It  is  presented  here 
in  full  because  it  is  in  itself  almost  a  complete  check  list  of  circum- 
stances which  must  be  considered  in  organizing  the  results  of  a 
comprehensive  survey. 
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To  Compile  Quantitative  Statistical  Tables.  With  an  outline 
prepared  for  guidance,  the  organization  of  the  statistical  or 
quantitative  data  may  proceed  with  denned  direction.  A  great 
mass  of  material  is  to  be  brought  into  orderly  arrangement,  into 
tables  principally,  for  study.  It  is  in  this  process  that  facts  will 
be  developed  and  laid  side  by  side,  for  comparison,  for  contrast, 


QUESTION  NO.  Dlr...B-2uSE  CARDS: 
COLUMN  NO..  I5 

SHEET  1^ 
STRAIGH 

K).— -J* 

T 

CARD  NO 

TO  YOUR  KNOWLEDGE,  HAVE  ANY  OF  YOUR  CUSTOMERS  DECIDED  NOT 
TO  PURCHASE  AN  ARTICLE  BECAUSE  IT  WAS  NOT  WRAPPED 

ITEM 

CODE 

COUNT 

PER  CENT 

TOTAL 

Yes 
No 

150 
151 

5,010 

4964 

1620 
3344 

32. 
67. 

6 

4 

^Interviews  thrown  out 
for  various  reasons. 

REJECT..4§?._. 

Fig.  24. — Form  for  first  sorting  of  replies  on  each  question. 

for  confirmation  or  for  contradiction — to  the  end  that  every 
significant  aspect  of  the  subject  may  be  studied  in  its  relationship 
to  all  the  others.  This  is  the  scientific  approach  in  all  fields  of 
research  and  it  is  only  through  such  a  process  that  conclusions 
of  assured  soundness  can  be  drawn. 

There  are,  of  course,  several  methods  of  arranging  research 
material  into  tables:  first,  the  tabulating  may  be  done  by  machine 
or  by  hand.     If  it  is  done  by  machine,  the  cards  must  be  punched 
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in  accordance  with  the  coding  system  as  described  in  Chap.  XIV 
on  Mechanical  Tabulation.  Then,  the  first  countings  can  be 
made,  representing,  usually,  a  " straight"  sorting  of  the  replies  to 
each  question  and  the  results  may  be  set  up  on  tabulation  sheets 
or  forms,  as  shown  in  Fig.  24. 


QUESTION  N0.'.MJLtB-2USE  CARDS: 

SHEET  NO...    27 

COLUMN  N0....15 SORTING  NC 

L..S. 

CARD  NO 

STRAIGHT 

TO  YOUR  KNOWLEDGE,   HAVE  ANY  OF  YOUR  CUSTOMERS  DECIDED 
NOT  TO  PURCHASE  AN  ARTICLE  BECAUSE  IT  WAS  NOT  WRAPPED: 

500,000      100,000      50,006        25,000       15,000 
and              to                to                to               to 
Size  of  Cities               over        500,000      100,000      50,000        25,000 

CODES: 

0 

1 
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3 

4 

No.  of  Cards  Used 

1648 

1175 

867 

771 

5^ 

19 

ITEMS 

Code 

Count 

% 

Count 

% 

Count 

% 

Count 

% 

Count 

% 

TOTAL 

1632 

116S 

859 

764 

546 

Yes 

150 

503 

30 

8 

282 

24 

4 

237 

27 

6 

347 

45 

4 

251 

46 

2 

No 

151 

1129 

69 

2 

881 

75 

6 

622 

72 

4 

417 

54 

6 

295 

53 

8 

. 

REJECTS             16                     12                  8                  7                     3 

Fig.  25. — Form  showing  data  broken  down  as  to  size  of  cities. 


Careful  study  of  these  "  straight "  tabulations  will  indicate  what 
cross  analyses  are  possible  or  relevant  or  necessary.  Most 
problems  require  that  all  the  "straight"  analyses  be  broken  down 
with  respect  to  all  known  factors.  For  example:  if  1,620  persons 
said  "Yes"  to  the  question  stated  in  Fig.  24,  and  3,344  said 
"No,"  it  might  be  highly  constructive  to  know  what  proportion 
of  these  people  were  men;  to  what  income  classes  they  belonged; 
in  what  occupations  they  were  engaged ;  what  kind  of  cities  they 
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came  from;  what  sort  of  stores  or  houses  they  had;  and  many 
other  things. 

In  a  marketing  study  every  distinguishable  feature  must  be 
investigated.  It  must  be  set  apart  and  examined  for  its  bearing 
on  the  object  of  the  study.     And,  for  orderly  procedure,  all  of 


QUESTION  NO.. 

Dlr.   B-&JSE  CARDS: 

SHEET  NO.._ .28-          _ 

COLUMN  N0....A5 

SORTING  NO...?. 

•CARD  NO 

STRAIGHT 

TO  YOUR  KNOWLEDGE,  HAVE  ANY  OF  YOUR  CUSTOMERS  DECIDED 

NOT  TO  PURCHASE  AN  ARTICLE  BECAUSE  IT  WAS  NOT  WRAPPED.                  \ 

Kind  of  store               Grocery     Dry  Cants     DrtiP 

CODES: 

100, 101 

102  to  106 

107,108 

No.  of  Cards  Used 

2202 

1973 

835 

ITEMS 

Code 

Count 

% 

Count 

% 

Count 

% 

Count 

% 

Count 

% 

TOTAL 

2181 

1956 

827 

•- 

Yes 

150 

930 

42 

7 

415 

21 

1 

279 

33 

8 

No 

151 

1251 

57 

3 

1541 

73 

9 

543 

66 

2 

REJECTS            21                      17                      8                                                         i 

Fig.  26. — Form  showing  data  broken  down  as  to  kind  of  store. 


these  variable  reflections  may  be  tabulated  and  set  up  in  a  form 
like  that  suggested  in  Figs.  25  and  26. 

It  will  be  noted  that  on  these  tabulation  sheets  all  countings  of 
cards  are  reduced  to  percentages.  This,  of  course,  is  to  establish 
a  comparable  base;  and,  in  computing  percentages,  the  figure 
customarily  used  as  a  base  is  the  net  number  of  replies  to  a 
question.  It  is  conceivable,  however,  that  for  special  reasons 
some  other  figure  may  be  regarded  as  the  base. 
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In  the  illustrations  used  it  will  be  noted  that  the  total  of  the 
percentages  in  each  column  represents  100.  This  would  not  be 
the  case,  however,  if  the  question  were  one  which  admitted  of 
several  replies  from  the  same  individual.  For  example,  if  the 
question  were:  "Do  you  smoke  Camel  cigarettes?"  the  answer 
would  be  "Yes"  or  "No."  In  this  case  the  sum  total  of  the 
answers  would  naturally  be  100  per  cent  of  all  the  replies  to  that 
question.  If,  however,  the  question  were:  "Why  do  you  prefer 
Camels?"  many  of  the  respondents  may  have  two  or  three 
reasons  for  preferring  that  brand.  So  that,  when  tabulated,  the 
sum  of  all  the  replies  to  any  such  question  is  likely  to  exceed 
100  per  cent  of  the  responses. 

When  the  tabulation  is  done  by  hand,  the  first  step  is  to  sort 
the  data  according  to  their  primary  or  most  obvious  divisions, 
just  as  is  done  with  machine  tabulation.  These  divisions  may  be 
determined  by  geographical  considerations,  as :  data  from  differ- 
ent states,  counties  or  cities;  or  urban,  suburban  or  rural  data;  or 
data  from  cities  of  various  sizes;  or  any  part  of  geographical 
areas.  This  first  sorting  may  be  determined  also  by  such  con- 
siderations as  income  or  race  or  occupation.  Whatever  criterion 
may  be  selected  to  control  the  first  classification,  it  will  generally 
be  found  to  represent  the  most  natural  answer  to  the  question, 
"What  is  the  first  or  most  important  thing  to  show?" 

With  the  questionnaires  so  sorted,  the  next  step  would  be  to 
tabulate  them,  separately,  in  each  division.  In  hand  tabulating 
there  are  two  operations:  the  first  is  the  actual  counting  and 
tabulation  of  the  questionnaires,  the  part  otherwise  done  by  the 
machine,  and  the  second  operation  is  the  assembly  of  all  the  data 
for  purposes  of  study. 

The  counting  may  be  done — by  the  usual  four-stroke-crossed 
system  (]j|[  =  5) — on  rough  sheets  or  on  a  work  sheet,  dependent 
somewhat  upon  the  length  and  complexity  of  the  questionnaire. 

Some  research  directors  build  their  work  sheets  exactly  like 
their  assembly  sheets,  particularly  where  the  columnar  form  of 
assembly  sheet  is  used.  In  these  cases  the  totals  of  various 
columns  are  transferred  from  work  sheets  to  identical  columns 
in  the  assembly  sheets. 

If  separate  sheets  are  used  for  assembly  purposes,  each  phase 
of  each  question  will  require  a  separate  page.  Conceivably,  this 
might  result  in  a  multiplicity  of  sheets.     Because  of  the  difficulty 
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in  comparing  data  on  separate  sheets,  particularly  where  many 
other  pages  intervene,  some  research  directors  prefer  the  columnar 
sheet  providing  a  column  for  each  question.  A  sample  of  just  a 
part  of  such  a  sheet  is  shown  in  Fig.  27. 
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Fig.  27. — Assembly  sheet  to  'demonstrate  use  of  "key"  to  accuracy  in  hand 
tabulating  (page  232). 

Where  either  of  these  types  of  sheets  is  used,  it  is  necessary  in 
hand  tabulation  frequently  to  balance  the  columns.  That  is  to 
say,  on  a  work  sheet  of  forty-eight  columns,  it  would  probably 
be  found  that  twenty  to  thirty  of  them  would  bear  some  definite 
relation  to  some  one  or  more  other  columns.  In  balancing  the 
columns,  the  tabulator  at  the  close  of  each  group  of  fifty  question- 
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naires  should  total  up  the  columns  and  determine  whether  or  not 
they  are  in  balance.  This  is  one  of  the  advantages  in  using  a 
replica  of  the  assembly  sheet  for  counting  and  tabulating. 

To  illustrate:  Fig.  27  presents  a  somewhat  disguised  and 
simplified  assembly  sheet  used  in  an  actual  study.  There  were 
sixty  columns  utilized  in  this  case  and  thirty-eight  of  them  were 
so  related  to  others  as  to  permit  precise  checking.  In  tabulating 
this  study,  manually,  each  tabulator  was  given  a  "key"  designat- 
ing exactly  how  the  columns  should  be  checked.  That  key, 
as  it  applied  only  to  this  small  section  of  the  assembly  sheet, 
would  read  as  follows : 

Test  A— Column  2:  a  +  b  =  Total  Column  No.  1. 

Test  B — Column  3:a+b+c  +  d  +  e  =  Total  Column  No.  1. 

Test  C — Column  lia  +  b+c  +  d+g+h  minus  the  sum  of  e  +  /  = 

Total  Column  No.  1. 
Test  D — Column  4:  a  +  c  +  g  minus  e  =  Total  of  "a"  in  Column  No.  2. 
Test  E — Column  4:  b  +  d  +  h  minus/  =  Total  of  ub"  in  Column  No.  2. 
Test  F — Column  5:a+6+c  =  a  +  b  in  Column  No.  4. 
Test  G — Column  5:  d  +  e  +/  =  c  +  d  in  Column  No.  4. 
Test  H — Column  6:  a  +  b  =  a  +  6  in  Column  No.  4. 

In  checking  the  columns  in  this  manner,  the  tabulators  should 
be  required  to  note  in  the  margin,  opposite  each  group  of  fifty 
tabulations,  that  all  these  checks  have  been  made — identifying 
them  specifically  by  the  respective  letters.  And,  to  impress  upon 
the  tabulators  the  necessity  for  accuracy,  they  should  be  required 
to  certify  to  these  checks  by  signing  them  with  their  own  initials. 
This  formality  is  not  difficult ;  in  no  way  does  it  slow  up  the  work 
and  it  holds  the  tabulators  closely  to  the  testing  routine. 

This  method  of  checking  does  not  provide  any  positive  assur- 
ance as  to  the  correctness  of  all  the  tabulations ;  where,  however, 
a  number  of  columns  do  balance,  at  least  a  probability  of  accuracy 
in  the  other  columns  is  fairly  established  and,  although  absolute 
certainty  in  tabulation  is  always  and  emphatically  to  be  aimed  at, 
a  "  probability "  is  usually  as  trustworthy  in  tabulating  as  it  is  in 
sampling. 

The  question  as  to  whether  the  tabulation  should  be  made  by 
machine  or  by  hand  is  sometimes  believed  to  rest  solely  on  the 
size  of  the  study,  the  number  of  interviews  and  the  number  of 
questions.  Some  research  agencies  have  adopted  a  more  or  less 
arbitrary    rule    that    wherever    the    number    of    questionnaires 
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exceeds  some  certain  figure — say,  three  or  four  or  five  thousand — 
machine  tabulation  should  be  used. 

It  would  seem  that  this  question  should  rest  not  upon  any- 
arbitrary  standard,  but  upon  a  consideration  of  the  practicability 
of  each  system  for  the  specific  study  in  hand. 

It  is  not  inconceivable,  for  instance,  that  even  with  larger 
studies,  hand  tabulating  might  be  made  thoroughly  reliable  and 
efficient  with  respect  to  all  the  essential  factors.  Not  very  long 
ago,  it  was  the  only  method  known  and  was  relied  upon  implicitly. 
In  determining  whether  to  tabulate  by  hand  or  not,  here  are  some 
of  the  factors  to  be  examined : 

Speed.  Suppose  that  in  a  certain  study,  6,000  personal  inter- 
views are  to  be  tabulated.  Suppose,  too,  that  the  questionnaire 
is  fairly  comprehensive  and  that  the  field  is  large  enough  to 
require  thirty  reporters.  This  would  constitute  a  fair-sized 
operation.  At  the  close  of  the  first  day  these  thirty  reporters 
would  bring  in,  perhaps,  a  thousand  completed  questionnaires. 
If  a  tabulating  force  has  been  assenlbled  and  instructed,  it  would 
be  possible  for  that  staff  to  tabulate  all  those  questionnaires  on 
the  second  day.  With  a  properly  organized  staff,  each  day's 
field  work  would  thus  be  tabulated  on  the  day  following — so  that 
one  day  after  the  close  of  the  field  work,  the  whole  tabulation  job 
should  have  been  completed.  Certainly  for  all  normal  purposes 
this  would  be  sufficiently  fast. 

Accuracy.  If  the  tabulators  are  instructed  to  apply  columnar 
checks  in  the  manner  previously  described,  there  is  a  degree  of 
accuracy  in  hand  tabulating  that  in  most  studies  would  suffice. 
Surveys  involving  a  thousand  questionnaires  are  customarily 
tabulated  manually  and  the  result  is  generally  regarded  as 
sufficiently  accurate.  Why,  then,  should  not  hand  tabulation 
of  two  thousand  be  just  as  reliable?  And,  if  so,  why  not  three, 
six  or  ten  thousand?  These  larger  quantities  might  require  more 
tabulators  or  take  a  little  longer  time,  but  it  does  not  seem  that 
size  in  itself  necessarily  impairs  the  chance  for  accuracy. 

Flexibility.  If,  in  hand  tabulating,  an  unusual  degree  of 
flexibility  is  required,  special  care  is  necessary:  first,  in  keeping 
clearly  segregated  the  major  divisions  of  the  work,  that  is,  the 
classes  into  which  the  data  are  initially  to  be  divided  and  studied; 
and,  second,  in  so  designing  the  various  work  sheets  as  to  main- 
tain that  segregation  with  respect  to  all  the  features  of  the  study. 
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It  will  be  noted,  for  example,  that  in  Fig.  27  income  classes 
were  set  up  and  carried  through  the  work  separately.  The  illustra- 
tion shows  only  a  part  of  the  "  B  "  income  group.  The  nature  of 
that  study  required  that  "  income,"  or  buying  capacity,  be  the 
major  division.  But  note,  too,  that  the  several  locations  were 
also  kept  separate  so  that  any  of  those  well-defined  neighborhoods 
or  sections  of  the  city  could  be  set  apart  and  compared  with  other 
sections  in  the  same  class  or  with  those  in  any  of  the  other 
income  groups.  Sparsely  settled  Bartonville,  for  instance,  could 
be  readily  compared  on  any  point  with  the  densely  populated 

West  End. 

Even  if  a  still  closer  breakdown  were  desired,  hand  tabulation 
should  offer  no  handicap.  For  instance,  if  it  were  necessary  to 
know  such  a  detail  as  "What  is  the  overlap  of  Newspaper  A 
with  Newspaper  B  in  the  area  bounded  by— (any  four  specific 
streets)  ?  "  it  could  readily  be  ascertained.  If  the  area  so  described 
should  happen  not  to  coalesce  with  any  of  the  original  districts, 
it  would  be  necessary  only  to  go  back  to  the  questionnaires  and 
set  up  a  new  work  sheet  for  a  new  tabulation  on  the  new  query. 

Convenience.  This,  of  course,  is  an  elastic  term.  If  one  has 
immediate  access  to  tabulating  machines,  under  one's  own  con- 
trol, the  factor  of  convenience  is  no  problem.  And  there  would 
be  no  question  as  to  how  the  work  should  be  done.  Where  it  is 
necessary,  however,  to  pack  up  some  thousands  of  questionnaires 
and  express  them  to  some  other  point  for  machine  tabulation  it 
may  be  quite  inconvenient. 

Suppose,  for  example,  that  after  shipping  the  questionnaires 
away,  disbanding  the  field  organization  and  withdrawing  from 
the  surveyed  area,  it  be  found  that  some  additional  reflections 
from  the  field  are  required  to  form  a  true  and  sure  conclusion. 
To  go  back  to  that  market  and  reopen  the  work  would  be  decid- 
edly inconvenient  and  costly,  besides.  Such  a  situation  might 
easily  occur,  however,  where  stabilization  graphs  are  being  carried 
simultaneously  on  several  income  groups,  to  insure  adequacy  of 
sample  on  each  class,  and  where  they  fail  to  stabilize  on  one  or 
more  of  the  groups. 

Again,  suppose  some  fact  or  circumstance  should  be  revealed 
which  cannot  by  any  possibility  be  reconciled  with  any  previous 
common  experience.  Good  research  would  seem  to  demand  that 
such  a  situation  should  be  examined  and  explained.     But  how 
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could  that  be  done  without  a  further  testing,  a  reopening  of  the 
work, .in  the  field? 

With  machine  tabulating  such  needs  may  not  come  to  light 
until  the  tabulating  is  finished.  With  hand  tabulating,  running 
concurrently  with  the  field  work,  such  a  situation  would  begin  to 
manifest  itself  at  once  and  could  be  run  down  without  delay  or 
interruption  to  the  rest  of  the  work. 

Credibility.  The  question  to  be  determined  in  connection  with 
this  factor  is  whether,  under  the  circumstances  surrounding  the 
study,  the  public's  acceptance — its  disposition  to  believe — can 
be  made  more  sure  by  one  or  the  other  of  the  two  methods  of 
tabulating.  Then,  would  the  difference  in  the  probable  degree 
of  acceptance,  taken  in  conjunction  with  the  other  factors,  be 
sufficient  to  direct  the  choice,  it  having  been  shown  that  a  practi- 
cal degree  of  accuracy  can  be  achieved  with  either  method? 

Cost.  Here  we  are  on  more  or  less  solid  ground.  If  tabulating 
machines  are  under  control  of  the  research  agency  itself,  cost 
figures  would,  of  course,  be  available.  If  the  tabulating  is  to  be 
done  by  an  outside  recording  company,  some  sort  of  estimate  can 
be  gotten  in  advance.  These  figures  the  research  director  can 
compare  with  the  agency's  own  estimate  of  the  cost  of  hand 
tabulating,  taking  into  his  calculations  the  number  of  tabulators, 
the  time  required  and  the  probable  rate  of  pay.  There  can  be 
no  close  forecast  of  cost,  however,  until  the  scope,  character  and 
number  of  questionnaires  have  been  determined  and  some  approxi- 
mation has  been  made  as  to  the  number  of  cross  references  likely 
to  be  required. 

These  are,  in  general,,  the  factors  which  should  be  considered  in 
determining  how  the  tabulating  is  to  be  done.  If  it  should  seem 
that  too  great  stress  has  been  put  upon  the  manual  system,  that 
is  only  because,  later,  an  entire  chapter  is  devoted  exclusively  to 
machine  tabulation  and  because  neither  method  should  be 
adopted  without  weighing  the-  adaptability  of  the  other  for  the 
case  in  hand. 


CHAPTER  XIII 
THE  ORGANIZATION  OF  DATA 

(Further  Elaboration  of  Step  B  in  Chart  G) 

While  the  effective  organization  of  quantitative  data  constitutes 
a  large  part  of  the  work  of  marketing  research,  almost  every  study 
produces  some  material  of  qualitative  character.  This  requires 
a  different  sort  of  organization,  which  will  now  be  considered. 

To  Summarize  Qualitative  Data.  Qualitative  data  have 
already  been  referred  to  as  including  all  that  class  of  information 
which  bears  on  the  subject  but  which  is  not  directly  amenable  to 
statistical  treatment.  The  value  of  such  data  rests  usually  upon 
the  relative  competency  of  their  source.  They  may  originate  in 
special  interviews;  in  which  case  the  identity  of  the  respondent, 
his  relation  to  the  subject  and  his  opportunity  for  dependable 
knowledge  are  the  factors  which  determine  the  value  of  his 
opinions  as  data.  Or,  in  recorded  shape  they  may  come  from 
reference  books,  government  reports,  clippings  from  the  public 
press  and  many  other  sources. 

Another  form  of  qualitative  data  is  the  comment  procured  from 
respondents  to  questionnaires — comments  made  either  voluntar- 
ily or  at  the  instance  of  the  interviewer.  This  is  a  very  important 
source  of  information,  as  it  frequently  reveals  deeply  hidden 
reasons  and  private  opinions  of  inestimable  value  in  the  solution 
of  a  marketing  problem. 

The  common  denominator  of  information  of  this  type  is  its 
thought  content.  It  is  usually  found  that  even  in  great  masses 
of  apparently  heterogeneous  material  a  few  clearly  distinguishable 
ideas  predominate.  The  process  of  tabulating  such  data,  there- 
fore, involves  the  psychological  techniques  described  in  Chap.  XI. 
It  entails  a  distribution  of  the  mass  of  material  into  classes,  as 
determined  by  the  clearly  denned  thought  content  in  each 
separate  item. 

This  might  be  done  by  examining  each  item  for  its  dominant 
thought  and  establishing  a  separate  sheet  for  each  new  idea.     To 
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illustrate  the  process:  In  an  actual  study  designed  to  ascertain 
whether  or  not  a  novel  type  of  confectionery  could  be  introduced 
and  marketed  profitably  in  a  certain  market,  it  was  found  that 
some  two  thousand  pertinent  observations,  drawn  from  dealers 
of  all  types,  classes  and  conditions,  could  be  reduced  and  dis- 
tributed into  as  few  as  seventeen  basic  ideas. 

In  that  case,  a  columnar  form  was  used,  instead  of  separate 
sheets,  and  as  each  new  idea  or  " slant"  emerged  from  the  mass 
of  information,  a  new  column  was  established  for  that  thought. 
For  instance,  seventy-one  merchant  respondents  felt  that  the 
effort  to  sell  this  new  confection  would  interfere  with  the  sale  of 
established  products.  Each  of  these  seventy-one  respondents 
expressed  this  idea  in  his  or  her  own  words,  differing  in  text  from 
all  the  others,  but  the  thought  content  was  identical  in  all  cases. 
Of  course,  with'some  individuals  this  was  only  one  of  several  reac- 
tions— some  favorable  and  some  unfavorable. 

Two  hundred  and  thirty-two  of  the  respondents — dealers  whose 
lines  might  reasonably  be  expected  to  include  the  commodity  in 
question — believed  that  it  was  not  suitable  to  their  business. 
Each  of  these  persons  expressed  himself  in  his  own  words.  But  in 
each  case  the  thought  content  was  clearly  determinable. 

The  next  step  was  to  weight  these  reflections  in  accordance 
with  the  authority  of  their  source.  A  street  pedler,  for  example, 
may  know  with  great  precision  what  he  can  himself  sell  but, 
obviously,  his  opinion  as  to  the  suitability  of  a  product  to  a 
nation-wide  market  would  have  considerably  less  value  as  a  guide 
to  a  manufacturer  than  would  the  judgment  of  the  merchandise 
manager  of  a  large  chain-store  system.  In  this  study  both  types 
had  contributed  to  the  mass  of  material— and  all  the  types 
in  between.  It  was  necessary,  therefore,  to  reexamine  these 
responses  in  the  light  of  competency  by  means  of  tables,  like 
that  shown  in  Fig.  28,  for  each  basic  idea. 

Upon  completion  of  this  assembly  sheet,  it  became  entirely 
clear  that  the  seventy-one  merchants  who  feared  the  introduction 
of  the  new  confection— because  of  its  possible  interference  with 
established,  products— were  preponderantly  women  proprietors 
of  more  or  less  advanced  years,  operating  small  neighborhood 
stores,  usually  in  a  slovenly  manner  and  with  an  attitude  gen- 
erally antagonistic  to  any  new  idea.  Because  these  conclusions 
were  inescapable,  there  was  no  necessity  for  considering  the 
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relative  weights  of  the  several  features  involved  in  this  tabula- 
tion— as  might  be  necessary  where  the  significance  of  the  data  is 
less  clear. 

In  the  manner  described,  each  of  the  seventeen  types  of 
responses  was  tabulated  and  studied.  Finally,  further  classifica- 
tion showed  that  all  of  the  unfavorable  reactions  found  in  this 
study  fell  into  two  general  groups.     The  first  group  represented 
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-Form  set  up  to  qualify  the  opinions  of  dealers  with  respect  to  a  new 
product. 


contingencies  which  are  common  in  the  introduction  of  any  new 
product  in  any  market — resistances  which  are  being  surmounted 
daily  by  competent  merchandisers  the  world  over.  The  second 
group  represented  contingencies  which  grew  out  of  certain  local 
marketing  customs  the  correction  of  which  would  require  some 
specific  educational  effort. 

These" latter  comments  may  seem  to  belong  to  the  realm  of 
interpretation.  It  is  one  of  the  characteristics  of  qualitative 
data,  however,  that  the  classification  involved  in  organizing 
them  so  opens  out  their  meaning  that  the  process  may  indeed 
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become  an  interpretative  one.  In  this  case  the  mere  organiza- 
tion of  the  material  reduced  a  mass  of  data  to  two  significant 
conclusions;  but  it  was  a  subsequent  function,  interpretation, 
that  related  those  two  conclusions  to  the  problem  as  a  whole. 

In  organizing  data  occasions  sometimes  arise  in  which  it  is 
necessary  to  determine  the  relative  value  of  data  by  a  process  of 
scoring.  For  instance:  In  a  study  of  a  bakery  product,  of  which 
there  were  a  number  of  competing  brands  more  or  less  active  in 
the  market,  it  was  desired  among  other  things  to  determine  how 
these  various  brands  stood  with  the  dealers  in  the  order  of 
preference. 

The  field  work,  which  embraced  a  large  number  of  dealer  inter- 
views, disclosed  that  some  of  them  were  using  consistently,  and 
by  voluntary  preference,  brand  A ;  of  that  number,  some  respond- 
ents declared  that  if  they  were  to  change  brands,  they  would  take 
brand  C;  others  professed  a  higher  regard  for  brand  D  or  B  or 
E — their  preferences,  in  fact,  spread  in  some  order  of  precedence 
over  all  of  the  brands.  Similarly,  the  dealers  using  brand  B 
expressed  varying  degrees  of  preference  for  some  other  brand  as 
their  first,  second,  third  choice,  and  so  on. 

Quite  clearly,  such  a  canvass  would  naturally  result  in  a  welter 
of  conflicting  impressions.  While  the  brand  being  actually  used 
and  presumably  preferred  by  a  dealer  would  most  often,  though 
not  always,  receive  a  first  place,  his  varying  degrees  of  preference 
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Note:  The  "N"  appearing  in  the  "D"  column  signifies  that  the  respondent  in  that  case 
had  volunteered  an  uncomplimentary,  or  "negative,"  comment  in  connection  with  that 
brand. 
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for  the  other  brands  had  to  be  given  consideration  at  varying 
weights. 

This  was  done  by  establishing  a  work  sheet  with  one  column 
devoted  to  each  of  the  competitive  brands.  Each  interview 
was  then  listed  by  number,  by  character  of  dealer  and  address. 
Then,  under  each  column  were  listed,  as  1,  2,  3,  etc.,  the  order  of 
preference  expressed  by  each  respondent  for  the  various  brands. 
The  tabulation  on  page  239  is  a  partial  illustration  of  such  a  setup. 

At  the  completion  of  this  setup  it  was  found  that  brand  A  had 
been  mentioned  as  first  preference  by  a  certain  number  of 
respondents;  brand  C  had  been  mentioned  as  first  choice  by  a 
certain  number  of  other  respondents;  that  B  and  D  and  E  each 
had  its  adherents;  and  that  each  of  the  brands  had  been  men- 
tioned some  number  of  times  for  second,  third  and  fourth  places. 
All  these  data  were  then  organized  as  follows: 


Firsts 

Seconds 

Thirds 

Fourths 

Brand  E  200 

Brand  A  140 

Brand  B  90 

Brand  B  20 

Brand  A  170 

Brand  B  110 

Brand  A  70 

Brand  D  20 

Brand  B     70 

Brand  E  110 

Brand  D  50 

Brand  A  10 

Brand  D     70 

Brand.  C     70 

Brand  E  40 

Brand  C  10 

Brand  C     20 

Brand  F     30 

Brand  C  30 

Brand  E    0 

Brand  F     20 

Brand  D     20 

Brand  G  10 

Brand  G     0 

Brand  G     20 

Brand  G     10 

Brand  F     0 

Brand  F     0 

Brand  H    20 

Brand  H    10 

Brand  #    0 

Brand  H    0 

Figures  Arbitrary. 

To  take  the  confusion  out  of  such  an  array  of  numbers,  these 
showings  were  reduced  to  a  common  basis  by  another  weighting. 
Arbitrarily  four  points  were  given  for  each  first  place,  three  points 
for  each  second  place,  two  points  for  each  third  place  and  one 
point  for  each  fourth  place.  It  was  then  found  that,  as  to  dealer 
preference,  brand  A — which  was  only  second  in  the  column  of 
" Firsts" — actually  led  the  field  with  1,250  points;  brand  E — 
which  headed  the  " Firsts"  column — was  only  a  fairly  close 
second  with  1,210  points;  brand  B,  a  not  very  close  third,  showed 
810  points;  brand  D,  fourth,  showed  460  points.  None  of  the 
brands  below  this  was  strong  enough  to  affect  the  marketing 
situation  in  that  city  in  any  material  manner. 

In  setting  up  various  types  of  qualitative  data,  some  imagina- 
tion and  ingenuity  are  required  in  the  organization.     But,  above 
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all,  is  judgment  necessary — to  the  end  that  the  desired  informa- 
tion shall  emerge  as  a  clear  and  sound  deduction. 
•  To  Prepare  Graphic  Records.  Probably  every  situation  that 
might  arise  in  marketing  research  can  be  adequately  described  in 
words — in  written  text.  But  that  is  not  always  sufficient.  The 
purpose  of  marketing  research  is  to  provide  a  factual  foundation 
for  some  constructive  or  corrective  action.  If  the  study  fails  to 
inspire  that  action,  it  is  a  sheer  waste.  It  is  imperative,  therefore, 
to  give  the  study  the  maximum  chance  of  achieving  its  purpose,  by 
dramatizing  its  conclusions  in  graphs,  charts,  maps  and  pictures. 

There  is  neither  room  nor  reason  to  attempt  here  any  complete 
work  on  the  preparation  of  graphic  records.  There  are  a  number 
of  standard  books  devoted  in  part  or  exclusively  to  this  form  of 
presentation  and  some  of  these  are  listed  in  the  bibliography  at 
the  end  of  this  book.  No  one  should  undertake  to  build  graphs 
and  other  graphic  devices  without  some  study  of  the  subject. 
The  purpose  here  is  rather  to  stress  the  importance  of  graphic 
records  as  a  means  of  organizing  data  for  more  effective  study 
and  as  an  aid  to  interpretation  and  to  the  presentation. 

With  a  mass  of  material  at  hand,  the  first  step  is  carefully  to 
examine  each  feature  so  as  to  determine  just  what  ideas  can  be 
made  more  effective  or  more  revealing  by  some  form  of  graphic 
presentation.  There  should  be  nothing  casual  about  such  an 
examination;  it  should  be  thorough  and  purposeful.  The  chance 
of  translating  the  study  into  action  may  depend  upon  executive 
recognition  of  some  one  point  which  might  be  entirely  overlooked 
if  left  embedded  in  the  text. 

The  next  step  is  to  choose  wisely  the  type  of  visual  presenta- 
tion that  will  most  surely  prove  effective.  There  is  a  wide  assort- 
ment open  to  choice  and,  if  there  is  any  doubt  as  to  the  superiority 
of  any  one  type,  it  is  usually  good  practice  to  try  two  or  more— 
until  that  one  is  found  which  most  truly,  most  clearly  and  most 
strikingly  presents  the  point. 

If  graphs  are  used,  the  circumstances  must  determine  whether 
the  relationship  between  the  variables  requires  one  curve  only 
or  several.  Normally,  ordinary  coordinate  paper  will  suffice; 
but  if  a  comparison  is  required  between  widely  separated  scales 
of  values  or  ideas  which  can  best  be  expressed  in  percentages,  the 
logarithmic  scale  would  probably  prove  more  accurate  and  more 
convincing  as  well. 
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Under  some  circumstances  it  may  be  desirable,  for  the  fuller 
comprehension  of  the  situation,  to  carry  cumulative  curves  on 
graphs  and,  for  comparative  purposes,  to  graph  frequency  tables,, 
correlations  and  trends.  In  almost  any  case,  some  experiments 
with  these  types  of  graphs  might  add  considerably  to  the  clarity 
of  a  final  report;  and  usually  graphs  are  preferable  to  the  more 
impressive  pictorial  methods.  They  are  simpler  to  produce  and 
are  as  a  rule  more  quickly  and  clearly  comprehended. 

If  charts  are  to  be  used,  a  choice  must  be  made  between  the 
"bar"  and  " circle"  forms.  For  most  purposes  either  might  be 
used,  although  for  several  reasons  the  "bar"  form  seems  the 
more  desirable.  It  is  simple  to  construct,  is  direct  and  positive 
in  its  presentation  and  can  be  readily  and  surely  interpreted. 

The  " circle"  chart  is  more  difficult  to  construct  to  scale  and 
even  where  the  sections  represent  component  parts  of  a  single 
unit,  they  are  not  easily  comparable.  Where  comparisons  are 
to  be  made  between  two  circle  charts,  and  their  respective  sec- 
tions, interpretation  is  confused  by  the  difference  between  diam- 
eter and  area.  Comparison  is  so  uncertain,  as  a  matter  of 
fact,  that  circle  charts  should  probably  never  be  used  for  purposes 
of  contrast. 

There  are,  of  course,  many  variations  of  both  bar  and  circle 
charts  and  it  would  be  well  to  refer  to  some  of  the  standard  works 
on  chart  making  for  examples  of  the  more  uncommon  variations, 
as  well  as  for  the  refinements  in  construction. 

Under  some  circumstances,  maps  can  be  made  most  effective 
in  presenting  ideas.  If  areas  are  to  be  compared,  one  map  may 
be  imposed  upon  another  by  silhouette  or  color  or  shading;  if 
density  of  population  is  to  be  shown,  dots  may  be  used  to  repre- 
sent some  designated  number  of  families  or  persons;  if  buying 
power  is  of  interest,  various  colors  may  be  used  to  indicate  the 
several  levels  of  income. 

Except  when  specific  and  exact  numbers  or  quantities  are 
involved,  the  map  offers  an  excellent  means  of  presenting  ideas 
clearly  and  impressively.  There  are,  too,  occasions  when  even 
quantitative  information  may  be  set  up  on  maps.  But  for 
effective  results  it  must  be  expertly  done. 

Where  maps  are  to  be  transported,  as  in  a  folio  or  printed 
presentation,  colors  and  several  types  of  shading  are  used  to 
illustrate  ideas,  while  locations  are  indicated  by  marks  of  varying 


THE  ORGANIZATION  OF  DATA  243 

significance.  But  when  maps  are  to  be  used  on  the  wall  or  in  a 
flat,  stationary  position,  pins  or  tacks  of  various  colors  and  shapes 
may  be  used  to  mark  location.  On  such  maps  areas  may  be 
bounded  by  stretching  strings  tautly  around  the  pins  or  tacks 
securely  fastened. 

Pictures  have  the  flexibility  and  other  advantages  of  maps — 
also,  their  disadvantages.  This  is  particularly  true  where  exact 
presentations  are  required.  The  principal  precaution  in  the  use 
of  pictures  is  that  some  scale  must  be  provided  by  which  to 
measure  visually  and  accurately  the  magnitude  of  the  idea  con- 
veyed. This  is  particularly  necessary  where  comparisons  are 
to  be  drawn  and  where  the  bulk  or  the  area  of  the  objects  used 
as  illustrations  is  likely  to  be  confused  with  their  height,  length 
or  other  linear  measurement.  Under  these  circumstances, 
greater  safety  would  probably  lie  in  using  a  succession  of  such 
objects,  each  representing  some  fixed  number  or  quantity  which 
can  be  translated  instantly  by  vision  into  the  proper  figure. 

In  discussing  the  presentation  of  the  report,  in  Chap.  XVII, 
the  subject  of  Graphic  Presentation  will  be  referred  to  again 
somewhat  more  in  detail. 

Analyze  Data 

At  this  point  in  the  process  of  organizing  data,  particularly 
data  of  the  quantitative  type,  begins  what  might  be  called  the 
approach  to  interpretation.  The  material  has  been  collected, 
separated  into  its  major  divisions  and  arranged  for  convenient 
and  effective  study.  The  next  step  is  to  bring  the  various  classes, 
of  data  into  such  relation  to  one  another  as  will,  when  completed, 
facilitate  the  interpretation  of  the  study  as  a  whole.  There  are 
several  means  to  this  end. 

To  Determine  Correlations,  Trends  and  Other  Relationships. 
An  abridged  treatise  on  these  devices  and  on  how  they  are  to  be 
computed  will  be  found  in  Chap.  XIX.  These  statistical  pro- 
cedures should,  of  course,  be  studied  further  in  some  of  the 
standard  works  on  the  subject.  The  point  here  is  to  choose 
which  of  these  forms  will  give  the  greatest  aid  in  organizing  the 
data  for  clear  interpretation. 

Correlations  can  be  depended  upon  to  reveal  what  has  taken 
place  and  what  is  currently  transpiring.  They  are  expressed  in 
terms  of  contrast  or  comparison  among  the  various  factors  and 
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are  so  measured  as  to  fix  with  some  precision  the  influence  of 
those  factors  on  the  situation  as  it  appears.  To  find  out  what 
those  factors  indicate  is  the  first  step  toward  understanding  the 
results  of  the  study. 

Whether  correlations  are  actually  to  be  set  up  in  graph  form 
and  used  in  a  final  report  or  not,  every  such  relationship  that 
may  be  suggested  by  the  data  should,  during  this  period  of  organ- 
ization, be  computed  and  studied  for  its  bearing  on  the  objectives 
of  the  research. 

Trends  are  designed  to  show  what  may  happen  in  the  future. 
Where  the  study  requires  a  prognosis,  therefore,  the  material 
should  be  considered  in  the  light  of  the  results  or  the  consequences 
likely  to  ensue — first,  if  conditions  remain  unchanged;  second,  if 
any  of  the  factors  are  altered  or  removed;  and  third,  if  any  pre- 
dictable factor  should  enter  the  situation  as  a  new  element. 

In  the  second  and  third  of  the  foregoing  contingencies,  it  would 
be  necessary,  of  course,  to  determine,  by  study  and  estimate,  in 
just  what  degree  the  factors  in  question  are  capable  of  affecting 
the  trend.  And  such  estimates  may  be  made  from  the  data 
already  assembled  or  may  require  an  entirely  new  research. 

To  Apply  Statistical  Adjustments.  There  are  circumstances 
under  which  data,  although  relevant,  are  unsuited  to  the  purpose 
of  the  study  in  the  precise  state  in  which  they  are  drawn  from 
the  field.  Such  data  must,  by  adjustment,  be  brought  into 
line  with  the  purpose  of  the  study.  Familiar  examples  of  this 
process  are  the  adjustments  necessary  for  seasonal,  cyclical  and 
accidental  fluctuations  in  computing  trends  for  forecasting. 

To  Develop  Collateral  Data.  In  the  mass  of  data  resulting 
from  any  field  survey  that  is  at  all  extensive  there  is  likely  to  be 
found  considerable  material  not  directly  responsive  to  the  issue 
but  which  may,  nevertheless,  shed  significant  and  important 
side  lights  on  the  conclusions. 

Such  collateral  data  may  confirm  or  contradict  the  major 
conclusions  in  a  study.  In  the  latter  case,  and  where  no  adjust- 
ment seems  feasible,  both  the  direct  and  the  collateral  data  must 
be  subjected  to  re-examination.  Obviously,  two  contradictory 
conclusions  cannot  both  be  true.  The  point,  then,  is  to  deter- 
mine which  of  the  two  types  of  data  is  the  more  reliable  and  to 
what  extent  its  reliability  is  impugned  by  the  contradictory 
collateral  data. 
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This  adjustment  might  be  effected  by  retesting  either  the 
direct  or  the  collateral  data — even  to  the  extent  of  doing  some 
of  the  work  over.  Certainly,  contradictory  data  should  never 
be  ignored.  And,  if  it  cannot  be  removed  or  controverted,  it 
must  be  set  up  and  presented  side  by  side  with  the  other  material 
for  exactly  what  it  may  be  worth. 

Select  for  Final  Use 

After  completing  the  processes  outlined  in  steps  A>  B  and  C, 
it  is  obvious  that  much  sifting  has  already  been  accomplished 
and  that  the  material  has  arrived  at  a  fairly  orderly  state.  At 
this  point,  however,  it  is  frequently  necessary  to  weed  out  some 
of  the  less  important  data  and  to  take  the  steps  necessary  to  assure 
that  none  of  the  really  significant  data  shall  escape  consideration. 

According  to  Object  as  Denned.  At  the  very  beginning  of 
the  study,  in  the  phase  represented  by  Chart  C,  on  page  12, 
certain  objectives  were  determined  upon  and  defined.  Now, 
with  the  material  at  hand,  it  is  necessary  first  to  set  aside  every 
ascertained  fact  which,  in  any  way  whatever,  bears  upon  those 
original  objectives. 

Where  the  questionnaire  has  been  carefully  prepared  and  the 
field  work  thoroughly  and  conscientiously  executed,  it  is  probable 
that,  in  some  degree,  all  of  the  material  is  pertinent.  That  is 
to  say,  all  the  data  should  tend  to  disclose  the  truth  regarding 
the  facts  or  circumstances  which  underlie  the  study.  Any  data 
which  clearly  do  not  so  tend  can  safely  be  discarded. 

This  does  not  mean,  of  course,  that  data  not  favorable  to  a 
predetermined  position  may  be  thrown  out.  Such  a  prerogative 
is  not  to  be  considered.  All  sincere  studies  must  seek  the  truth, 
regardless  of  any  previous  convictions.  Only  such  data  may 
be  discarded,  therefore,  as  are  found  to  add  nothing  to  the  solu- 
tion of  the  problem  and  whose  elimination  takes  nothing  essential 
away  from  the  study. 

According  to  Importance.  Not  all  of  the  material  assembled 
in  a  study  can  have  the  same  value  with  respect  to  the  defined 
objectives.  After  any  palpably  inconsequential  data  that  may 
have  been  gathered  have  been  eliminated,  the  next  step  is  to  set 
up  the  usable  material  in  the  order  of  its  importance.  With 
the  basic  objectives  of  the  study  held  in  mind  this  selection  is 
predicated  upon  some  such  criterion  as  "What  is  the  most  prac- 
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tical  fact  or  group  of  facts  to  present  first  in  a  report  on  this 
study?     What  is  next  in  importance?"  and  so  on. 

According  to  Expedience.  Under  no  circumstances  should 
expedience  be  permitted  to  distort,  or  even  faintly  to  color,  the 
conclusions  of  a  study.  In  the  selection  of  material  for  final  use, 
however,  there  are  situations  in  which  authentic  data  may  be 
stressed  beyond  their  seeming  weight  or  given  precedence  over 
other  data  of  apparently  greater  intrinsic  importance. 

For  example :  Where  the  final  result  of  a  study  clearly  indicates 
a  certain  course  of  action  as  highly  desirable  or  imperative,  those 
findings  should  be  emphasized  which  seem  most  likely  to  lead 
to  the  necessary  executive  action.  In  such  a  case,  the  selection 
of  data  for  final  use  would  be  governed  not  by  importance  alone 
but  also  by  expediency. 

In  exercising  such  a  latitude  as  this,  however,  it  must  be  remem- 
bered that  only  authenticated  material  may  be  used  at  all  and 
that  no  ascertained  fact  can  honestly  be  altered  or  detached 
from  its  actual  and  full  meaning  to  meet  any  situation.  It  means 
only  that  the  authenticated  material  may  be  presented  in  such 
a  sequence  or  arrangement  as  will  most  likely  result  in  the  action 
desired. 

Provide  for  Report 

The  final  step  in  organizing  data  is  to  prepare  the  way  for  the 
report.  The  actual  preparation  of  the  report  will  be  discussed 
in  Chap.  XVII,  but  for  that  purpose  certain  material  must  be 
made  ready  during  this  period  of  organization.  As  a  matter  of 
fact,  the  report  has  probably  been  held  closely  in  mind  since  the 
inception  of  the  work  and  everything  that  has  been  done  has 
been  directed  to  the  requirements  of  that  conclusive  statement 
which  nominally  closes  the  study. 

At  this  point  it  is  likely  that  all  the  other  material  necessary 
for  the  completion  of  the  report  will  have  been  procured  and 
organized  and  that  nothing  further  remains  but  the  following 
considerations : 

Record  of  Data  Sources.  It  is  not  sufficient  for  a  research 
director  to  assure  himself  that  the  sources  he  has  referred  to  for 
his  data  are  authentic  and  sound.  He  must  convey  that  con- 
fidence to  every  interested  person  who  may  read  the  report.  For 
this  reason  he  should,  as  part  of  the  organizing  process,  prepare 
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a  complete  statement  of  his  data  sources.  Then,  each  person 
interested  in  the  report  may  determine  for  himself  whether  or 
not  those  sources  are  likely  to  have  yielded  information  of  the 
proper  degree  of  reliability. 

List  of  Authorities  and  References.  The  same  considerations 
obtain  with  respect  to  opinions  and  experience  gathered  from 
individuals  in  the  course  of  the  field  work.  Some  reference  to 
those  authorities  must  be  prepared  and  made  ready  for  the 
report.  The  readers  concerned  with  that  report  have  the  right 
to  determine,  each  for  himself,  how  much  credence  he  is  inclined 
to  give  to  the  data  procured  from  the  sources  listed. 

Exposition  of  Plan  and  Method  of  Survey.  For  the  same 
reasons  every  reader  of  a  report  should  be  in  a  position  to  decide 
for  himself  whether  or  not  the  survey  has  been  conducted  in 
accordance  with  approved  methods.  As  a  part  of  the  organizing 
process,  therefore,  a  statement  should  be  prepared  as  to  just 
how  each  step  has  been  planned  and  accomplished— beginning 
with  the  preparation  of  the  questionnaire,  the  training  of  the  field 
workers,  the  method  of.  selecting  the  sample  and  carrying  the 
process  through  to  the  end.  Further,  such  a  statement  should 
not  only  tell  how  the  work  has  been  done  but  should  also  define 
the  qualifications  of  the  persons  who  executed  the  study. 

More  will  be  said  about  some  of  these  matters  when  they  arise 
again  in  connection  with  the  actual  preparation  of  the  report. 
In  the  meantime,  those  deliberations  must  be  carried  forward 
which  are  to  give  the  study  whatever  constructive  value  it  is  to 
have. 


CHAPTER  XIV 
MACHINE  TABULATION 

Having  discussed  at  some  length,  in  Chap.  XII  the  process  of 
tabulating  by  hand,  it  seems  appropriate,  here,  to  present  the 
whole  subject  of  machine  tabulating.  This  is  regarded  as  the 
modern  method.  It  brings  the  statistical  phase  of  marketing 
research  into  accord  with  the  mechanistic  spirit  of  the  day  and 
in  some  types  of  surveys  it  offers  highly  practical  advantages. 
Machine  tabulation  involves  a  technique  of  its  own  and  its 
importance  warrants  a  somewhat  detailed  description  of  its 
operation. 

The  Mechanical  Process 

Tabulating  machines  perform  virtually  all  the  operations 
required  for  the  keeping  of  accounting  and  statistical  records. 
They  sort,  select  or  classify  limitless  quantities  of  miscellaneous 
facts  and  then  count  all  those  of  like  classification.  These 
machines — the  Hollerith  and  the  Powers1 — operate  on  the  same 
principle.  Punched  forms — "  tabulating  cards" — are  passed 
through  the  machines  automatically  and  at  the  rate  of  several 
hundreds  per  minute.  The  principle  on  which  the  machines  are 
constructed  is  that,  during  the  passing  of  the  cards,  electrical 
impulses  are  made  through  the  punched  holes,  rapidly  closing 
electric  circuits  from  various  fixed  positions  on  the  card  and 
causing  it  to  move  and  register  according  to  design. 

Figure  29  shows  a  blank  Hollerith  tabulating  card.  It  pre- 
sents 80  columns  of  digits  across  the  card,  each  column  containing 
12  punching  positions.  Of  these,  10  are  indicated  in  vertical 
sequence  by  the  printed  numerals  0  to  9,  which  correspond  to 
the  digits  of  the  numerical  information  to  be  punched.     The  11th 

1  The  Hollerith  machine  is  made  by  the  International  Business  Machine 
Corporation  and  the  Powers  by  Remington  Rand,  Inc. — Powers  Accounting 
Machine  Division.  No  significance  is  to  be  attached  to  the  fact  that  the 
machines  pictured  here  are  of  the  Hollerith  design.  They  are  intended  sim- 
ply to  illustrate  the  several  processes  described  in  the  text. 
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and  12th  punching  positions  are  located  at  the  top  of  the  card 
for  special  uses  and  are  not  indicated  by  the  printed  numerals. 
If  the  card  were  completely  punched  it  would  contain  960  holes — 
80  columns  of  12  positions  each. 
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FIG#  29. — Blank  tabulating  card  (Hollerith  type). 

The  Powers  punch  card  may  have  as  many  as  90  vertical 
columns  of  digits  from  0  to  9  with  a  possibility  of  two  extra 
digits,  making  12  in  all.  Samples  of  Powers  cards  follow  (Figs.  30 
and  31)  showing  the  45-  and  90-column  forms,  the  80-column 
form  being  practically  identical  with  the  Hollerith  card: 
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Fig.  30. — Blank  tabulating  card  (Powers  45-column  type). 

In  the  90-column  card  the  first  45  columns  are  placed  in  the 
upper  half  of  the  card  and  the  last  45  columns  in  the  lower  half. 
The  ten  digits  are  indicated  in  each  column  by  a  single  hole 
punch  to  express  an  odd  digit  and  a  combined  hole  punch  to 
express  an  even  digit. 


250 


THE  TECHNIQUE  OF  MARKETING  RESEARCH 


The  first  step  in  the  use  of  either  system  is  to  set  off  or  designate 
certain  groups  of  columns  as  "fields" — each  field  defining  a  sec- 
tion of  the  card  in  which  one  particular  item  of  information  is 
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Fig.  31. — Blank  tabulating  card  (Powers  90-column  type). 

always  to  appear.  Each  field  is  assigned  a  sufficient  number  of 
columns  to  include  the  largest  number  of  digits  which  it  can  be 
called  upon  to  accommodate.  For  ex- 
ample, to  record  date  (month  and  day) 
four  columns  are  reserved — two  for  month, 
since  months  amount  to  twelve  in  num- 
ber1; and  two  for  "day,"  since  days 
amount  to  31  in  number.  The  illustra- 
tion following  (Fig.  32)  shows  the  date 
December  24  punched  in  the  card — "12" 
for  month  and  "24"  for  day. 

For  analyzing  a  questionnaire  survey, 
the  original  data — the  answers  on  each 
questionnaire — are  transcribed  to  a  tabu- 
lating card  in  the  form  of  punched  holes 
in  the  fields  previously  set  off  and  identi- 
fied with  the  various  items  of  data.  The 
positions  to  be  punched  out  are  deter- 
punohede;nhnd°afte0ard  mi«ed  by  the  numerical  coding  of  all 
potential  answers.  Since  the  sorting  and 
counting  machine  is  caused  to  operate  only  by  numbered  holes 
punched  in  cards,  the  answers  to  each  question  must  be  assigned 
1  If  the  eleventh  and  twelfth  punching  positions — at  the  top  of  the  card — 
are-used  to  designate  the  months,  only  one  column  need  be  used  since  there 
would  then  be  twelve  positions. 
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code  numbers  and  it  is  these  numbers  which  are  punched  out  in 
the  proper  card  "  fields."  For  example,  the  potential  answers  to 
a  particular  question  might  be  "  Yes"  (coded  "1"),  " No"  (coded 
"2"),  and  "Do  not  Know"  (3).  Proper  coding  is  a  very  impor- 
tant consideration  for  the  effective  use  of  the  machines  and  will 
be  treated  in  some  detail  on  later  pages. 

The  cards  to  be  punched  are  placed  in  an  electric  punching 
machine  (Fig.  33)  which  has  a  keyboard  consisting  of  twelve  keys, 


Fig.  33. — Picture  of  punching  machine  (Hollerith  motor-drive  key  punch). 

one  for  each  punching  position  of  a  column.  As  a  key  is  depressed, 
a  hole  is  cut  and  the  card  advances  automatically  to  the  next 
column  to  be  punched.  Or,  if  it  is  desired,  several  holes  may  be 
punched  in  a  single  column.  The  action  of  the  key-punching 
machine  is  easy  and  rapid.  This  is  the  only  operation  in  which 
the  human  element  enters;  the  punching  must  be  done  by  an 
operator  but  there  are  effective  safeguards  against  error  even 
here.  From  this  point  on,  however,  all  the  tabulating — the 
sorting  and  counting — operations  are  performed  automatically. 
The  punched  cards,  in  miscellaneous  order,  are  placed  in  the 
electric  "counting  sorter"  machine.  By  a  simple  motion  the 
sorter  is  set  to  sort  all  cards  on  a  particular  column,  according 
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to  the  position  punched  out  in  that  column.  The  machine  is 
then  started  in  motion  by  pressing  a  button.  As  the  cards  pass 
rapidly  through  the  machine,  each  card  is  automatically  directed 
into  a  specific  receptacle,  or  "  pocket,"  according  to  the  position 
of  the  punched  hole.  Referring  again  to  the  type  of  answers 
previously  mentioned — the  cards  punched  "1"  (Yes)  would  be 
directed  to  the  first  pocket,  those  punched  "2"   (No)  to  the 


Fig.  34. — Electric  counting  sorter  (Hollerith  type). 

second  pocket  and  those  punched  "3"  (Do  not  know)  to  the 
third  pocket,  and  so  on. 

The  counting  sorter,  as  shown  in  Fig.  34,  contains  a  pocket 
for  each  punching  position  and  one  pocket  for  cards  unpunched, 
the  latter  indicating  unanswered  questions.  There  are,  there- 
fore, thirteen  pockets  in  all.  At  the  top  of  the  machine  are 
fifteen  five-position  counters,  one  counter  corresponding  to  each 
sorting  pocket,  one  for  a  subtotal  and  one  for  a  grand  total.  As 
each  card  reaches  a  pocket,  its  entry  is  registered  in  the  corre- 
sponding counter  as  well  as  in  the  subtotal  and  grand-total 
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counters.  Thus  when  all  cards  have  passed  through  the  machine, 
the  counter  dials  show  the  number  of  cards  in  each  pocket,  the 
total  number  in  all  pockets  and  a  grand  total.  The  counts  stand- 
ing in  the  dials  are  then  posted  to  survey  analysis  sheets,  which 
will  be  described  presently. 

Then,  for  each  separate  question,  the  cards  are  resorted  and 
counted  and  the  counts  for  each  different  answer  are  read  from 
the  dials  and  posted  to  the  analysis  sheets.  It  is  also  possible,  of 
course,  to  handle  in  the  same  way  all  those  answers  for  which 
several  digits  are  punched  in  a  single  column,  without  disturbing 
the  sequence  of  the  cards. 

By  means  of  the  sorting  operation,  certain  groups  of  cards  may 
be  automatically  selected  for  any  further  analyses  that  may  be 
desired.  For  example,  those  cards  showing  a  "Yes"  answer  to 
a  certain  question  may  be  reanalyzed  for  additional  information, 
such  as  geographical  location  by  city,  county  or  state.  Each 
of  such  subgroups  may  again  be  analyzed  as  to  various  ages, 
occupations,  makes  of  automobiles  used,  etc.  The  most  impor- 
tant advantage  of  the  mechanical  method  is  that  in  this  manner 
it  facilitates  the  handling  of  complex  tabulations,  requiring  a 
great  many  correlations  and  cross-references  rapidly  and  accu- 
rately secured. 

The  Questionnaire 

A  questionnaire  to  be  analyzed  by  the  machine  tabulating 
method  may  take  the  form  of  a  sheet  or  card  of  any  convenient 
size.  If  not  too  long,  the  question  form  itself  may  be  used  as  a 
tabulating  card.  When  questionnaires  and  tabulating  cards 
are  thus  combined,  they  are  called  "dual"  cards;  that  is,  they 
contain  information  in  both  written  and  punched  form. 

The  combined  tabulating  card-questionnaire  form,  as  illus- 
trated in  Fig.  35,  has  the  advantage  of  being  in  itself  both  the 
tabulating  record  and  the  original  "source"  record.  The  punch- 
ing of  such  cards  is  especially  easy  and  rapid,  since  the  operator 
need  not  look  back  and  forth  to  a  separate  source  record.  All 
dual  cards  are  specially  designed  with  the  correct  relative  position 
of  written  and  punched  information  and  with  a  common  sequence 
for  both. 

If  the  questionnaire  forms  are  to  be  preserved  for  reference, 
the  tabulating  card  form  is  especially  suitable.     It  is  small, 
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compact,  substantial  but  not  bulky  and  for  these  reasons  easy 
to  handle.  For  the  same  reasons,  tabulating  cards  are  convenient 
for  field  surveys — the  card  fitting  into  small  space  and  the  pack 
serving  as  a  support  while  writing  or  checking  answers  in  a  stand- 
ing position.  Incidentally,  some  saving  in  stationery  is  realized 
with  the  use  of  the  dual  card,  since  this  single  record  serves  the 
purpose  both  of  writing  and  of  punching. 

As  a  convenient  development  the  tabulating  card-questionnaire 
may  also  be  designed  as  a  postal  card,  with  return  address  pre- 
printed on  the  reverse  side  as  illustrated  in  Fig.  36a  and  b. 

Probably  the  greatest  contribution  the  punch-card  method 
has  made  in  the  marketing  research  field  has  been  in  the  tabula- 
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Fig.  35. — The  combined  tabulating  card-questionnaire  form. 

tion  of  questionnaire  data.  Naturally,  the  degree  in  which 
machine  tabulation  can  be  applied  to  questionnaire  work  depends 
largely  upon  the  nature  of  the  study  and  the  form  employed. 

The  number  of  interviews,  number  and  nature  of  questions  and 
amount  of  cross  tabulations  are  the  factors  generally  considered 
in  determining  what  method  of  tabulating  should  be  used.  Very 
frequently,  however,  a  study  involving  even  a  few  questionnaires 
with  a  limited  number  of  questions  may  prove  to  be  a  practical 
punch-card  job,  because  of  the  many  correlations  required. 

In  setting  up  a  questionnaire  survey  for  punch-card  tabulating, 
one  card  usually  represents  a  questionnaire,  and  a  column  or 
group  of  columns  on  a  card  represents  each  question.  As  previ- 
ously stated,  a  column  on  a  card  has  a  capacity  for  twelve  sub- 
divisions or  twelve  answers  to  a  particular  question.  For 
example,  a  brand  query,  listing  twelve  specific  brands  can  be 
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transcribed  to  a  single  column  on  the  card.  To  facilitate  efficient 
punching,  the  questionnaire  should  be  most  carefully  planned 
as  to  the  arrangement  of  the  questions  and  the  classifications 
under  those  questions. 
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Fig.  36a. — Front:  Questionnaire  and  tabulating  card. 


As  to  the  important  feature  of  coding  questionnaires  for 
machine  tabulation  there  are  several  practices  in  common  use. 
They  apply  also  to  manual  tabulation.  First,  the  questionnaire 
may  be  completely  precoded — or  it  may  be  partially  precoded — 
or  it  may  not  be  precoded  at  all. 
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Fig.  36&. — Back:  Return  postcard. 


The  Completely  Precoded  Questionnaire  is  one  wherein  all 
answers  to  questions  have  been  predetermined  and  printed  on 
the  questionnaire.     To  the  right  of  the  printed  answers  is  printed 
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a  code  number.  It  is  either  a  two-  or  a  three-digit  figure;  the 
units  digit  representing  the  code  number  within  the  column  and 
the  tens  and  hundreds  digits  representing  the  column  on  the  card. 
For  example,  a  specific  brand  listed  under  a  brand  question 
might  carry  the  number  121,  indicating  that  the  number  1  hole 
should  be  punched  in  the  twelfth  column  of  the  card;  122  would 
be  another  brand  in  the  same  column;  123  a  third,  etc. 

Except  for  mail  questionnaires,  the  completely  precoded  ques- 
tionnaire is  the  most  efficient  form  for  punch-card  tabulating. 
It  is  true  that  some  questionnaires,  as  well  as  some  questions,  do 
not  lend  themselves  to  precoding,  because  all  the  possible  answers 
to  the  questions  cannot  be  predetermined.  But  in  large  studies, 
where  adequate  preliminary  surveys  are  made,  sufficient  advance 
information  is  usually  obtained  to  make  predetermined  classifica- 
tions reasonably  practical  and  safe. 

Because  the  advisability  of  setting  up  these  predetermined 
classes,  or  check  lists,  is  a  somewhat  controversial  question,  a 
brief  discussion  of  the  subject  here  may  be  worth  while.  Those 
opposed  to  prelisting  the  possible  answers,  contend  that  the 
practice  results  in  inaccurate  reporting  from  the  field,  since  the 
investigator  may  carelessly  group  answers  into  the  conveniently 
indicated  classes.  Then,  too,  they  feel  that  when  the  answers 
appear  on  the  questionnaire,  the  negligent  investigator  may 
inadvertently  or  otherwise  suggest  those  replies  to  respondents. 
They  also  argue  that  many  comments  and  reasons  lose  much  of 
their  value  unless  abstracted  verbatim.  With  mail  question- 
naires, all  these  possible  dangers  are  even  more  likely  to  be  met. 

On  the  other  hand,  advocates  of  precoding  feel  that  the  advan- 
tages of  listing  the  probable  answers  outweigh  the  disadvan- 
tages. They  argue  that  the  " checking"  method  speeds  up  the 
interviews;  that  the  check  list  in  a  well-planned  investigation  is 
usually  based  on  actual  preliminary  sampling;  that  the  expense 
of  classifying  and  tabulating  " write-in"  data  is  unjustifiably 
high;  and,  that  in  editing  checked  lists,  the  percentage  of  error 
in  interpretation  is  probably  lower  than  when  the  interviewer 
interprets — as  he  does  by  placing  replies  into  generalized  groups 
of  his  own  divising. 

In  the  light  of  these  conflicting  views,  it  is  clear  that  no  hard- 
and-fast  rules  can  be  laid  down  to  govern  this  question  of  pre- 
coding.    Where  the  integrity  of  the  investigators  can  be  relied 
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upon,  and  where  past  experience  has  proven  their  sense  of  judg- 
ment, the  danger  of  misuse  of  precoding  in  the  field  is  not  con- 
siderable. In  a  simple  questionnaire,  where  the  answers  expected 
are  concise  and  easily  classified,  precoding  is  generally  advisable. 
"Yes-or-No"  questions,  time  questions  ("How  long  ago,"  "For 
how  long,"  "When  was  the  last  time"),  questions  for  which 
there  is  only  a  limited  number  of  answers,  such  as  "more,"  or 
"less,"  or  "same,"  and  many  other  similar  questions — all  lend 
themselves  readily  to  precoding.  In  "What  brand"  questions, 
much  depends  upon  the  number  of  major  brands  that  can  be 
expected.  Cigarettes,  soaps,  automobiles,  gasolines,  etc.,  usually 
are  precoded.  If,  as  in  the  case  of  automobiles,  a  distribution 
is  wanted  of  all  makes  of  cars,  it  may  be  worth  while  to  precode 
the  major  brands  and  leave  blank  columns  for  the  other  makes 
as  follows: 

What  make  of  car  do  you  own: 

Ford , 181 

Chevrolet 182 

Plymouth 183 

Buick 184 

Dodge 185 

DeSoto 186 

Chrysler. 187 

Other  (                                                               ) 18_ 

(                                                             ) 19_ 

(                                                             ) 20_ 

(                                                               ) 21_ 

"Reason  why"  questions  are  not  usually  precoded,  unless  the 
person  interviewed  is  asked  to  name  one  of  a  list  read  by  the 
interviewer,  or  unless  only  general  classifications  are  desired. 
The  questionnaire  shown  in  Fig.  37  is  an  example  of  a  fully  pre- 
coded  questionnaire. 

In  setting  up  the  tabulating  card  for  this  "Consumer  Cigarette 
Questionnaire"  the  first  four  columns  would  be  used  for  the 
questionnaire  number. 

Columns  5  and  6  on  the  card  would  be  used  to  indicate  city, 
Atlanta,  Georgia  being  "city  #32"  according  to  a  city  code.1 

Income  group  C  would  be  indicated  by  Code  73  which  means 
hole  "3"  in  Column  7. 

1  This  would  be  a  code,  devised  for  the  study,  in  which  each  of  the  cities 
to  be  surveyed  would  be  given  an  arbitrary  code  number. 
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CONSUMER  CIGARETTE  QUESTIONNAIRE 

riTyaten^S*      sT  6 

3,2 

4.   What  brand  did  you  smoke 
before  the  present  brand? 
Camel 

X 

141 

INCOME  GROUP            A 

71 

B 

72 

Chesterfield 

142 

C 

X 

73 

Lucky  Strike 

143 

D 

74 

Old  Gold 

144 

SEX 

Male 

X 

81 

Philip  Morris 

145 

Tareyton 

146 

Female 

82 

Spud 

147 

AGE 

20  &  under 

91 

Raleigh 

148 

Kool 

149 

21-34 

X 

92 

Wings 

140 

35-50 

93 

Others  (Specify) 

15_ 

Over  50 

94 

5.   (If    former    brand    used) 
Why  did  you  change? 
Taste 

161 

1.   What  brand  of  cigarettes 
do  you  smoke? 
Camel 

101 

Mildness 

162 

Chesterfield 

X 

102 

Throat-ease 

163 

Lucky  Strike 

103 

Price 

164 

Old  Gold 

104 

Habit 

165 

Philip  Morris 

105 

Packaging 

166 

Tareyton 

106 

Friend's  Recomm. 

167 

Spud 

107 

Advertising 

168 

Raleigh 

108 

Gave  it  a  triaf 

169 

Kool 

109 

Others  (Specify  felMMnm 

h 

,17i 

Wings 

100 

6.  What  recent  cigarette  ad- 
vertising   has    impressed 

18 

Others  (Specify) 

11_ 

2.  How  long  have  you  been 
smoking  this  brand? 
Less  than  6  months 

121 

192 

6  months  to  1  vear 

122 

7.  Where  did  you  see  it  ad- 
vertised? 

Magazine. 

X 

201 

1  vr.  to  less  than  2  yrs. 

123 

2yrs.  "    "       "    3   " 

124 

3  "    "    "      "    5   " 

125 

Newspaper 

202 

X 

126 

Don't  Remember 

127 

Radio 

203 

Car  Card 

204 

3.  Why  do  you  smoke  this 
brand? 

Taste 

X 

131 

Outdoor 

205 

Window  Display 

206 

Others  (Sppcifv) 

20_ 

Mildness 

X 

132 

NflrnP  JMlrt^  Jl71Ajbf\ 

Throat-ease 

133 

Price 

134 

Street  &  Numberi^Wfl  §6 
Int   Nam*-    VED 

Habit 

135 

Packaging 

136 

Others  (Specifv) 

13_ 

Fig.  37. — An  example  of  a  fully  precoded  questionnaire. 
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Question  5,  "Why  did  you  change/'  shows  one  answer  not 
precoded.  The  investigator,  in  this  case  writes  in  "  Don't  remem- 
ber "  on  the  line  marked  "  Other"  and  the  code  number  is  assigned 
after  the  questionnaires  come  in  from  the  field. 

The  heavy  black  lines  separate  columns  simply  as  an  added 
guide  for  the  key-punch  operator. 

The  Partially  Precoded  Questionnaire  is  similar  to  the  precoded 
one  with  the  exception  that  codes  for  those  questions  not  lending 
themselves  to  reasonable  predetermination  and  precoding  are 
omitted,  to  be  coded  after  the  questionnaires  are  returned. 

The  questionnaire  regarding  jams  and  jellies  shown  on  pages 
146  and  147  is  an  example  of  the  partially  precoded  type. 
Another  example  is  the  tabulating  card-questionnaire  shown 
in  Fig.  35.  This  latter  is,  in  effect,  partially  precoded  because 
the  proper  fields  to  be  punched  are  indicated  by  the  repetition  of 
field  captions  on  the  written  and  punched  sections  of  the  cards 
respectively. 

The  Unprecoded  Questionnaire  is  one  on  which  no  code  numbers 
are  entered  before  it  goes  to  the  field.  Too  frequently  the 
principal  has  set  up  his  own  questionnaire,  with  no  thought  of 
tabulation  whatever.  If  machine  tabulation  is  to  be  used,  it 
devolves  upon  the  research  man  to  code  the  questionnaires  as 
they  come  in  from  the  field.  In  such  cases,  code  numbers  must 
be  written  next  to  each  answer  under  each  question.  The  coding 
is  done  in  the  same  way  as  on  the  precoded  questionnaire,  but 
necessarily  becomes  a  manual  operation.  In  such  cases,  when 
the  questionnaire  is  returned  from  the  field,  preliminary  tabula- 
tions of  a  sampling  of  the  questionnaire  are  made  to  determine 
the  classifications  for  coding.  Questions  are  then  assigned 
columns  as  in  precoding.  But  here  it  is  not  necessary  to  indicate 
column  numbers,  provided  the  columns  are  coded  in  sequence. 
When  two  answers  appear  in  one  column,  they  are  written  side 
by  side.  When  a  question  is  unanswered,  an  R  (Reject)  is  writ- 
ten in  that  column  space.  In  this  way  the  key-punch  operator, 
,  by  punching  the  code  numbers  in  sequence  and  rejecting  them 
when  necessary,  accounts  for  the  same  number  of  columns  on  each 
of  the  cards,  with  each  question  punched  in  its  proper  column. 

As  an  example,  the  same  questionnaire  as  in  Fig.  37  is  shown 
in  Fig.  38  without  precoding.  All  answers  to  questions  are 
written   in  by   the   investigator   and   coded   later.     The   code 
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numbers  are  shown  on  the  extreme  right.  Here,  it  is  not  neces- 
sary to  indicate  column  numbers,  since  codes  for  columns  are 
listed  consecutively.     In  the  first  four  columns  the  questionnaire 


CONSUMER  CIGARETTE  QUESTIONNAIRE 

r-TTV      C^L^7^.S4HL. SEXL@     F 

INCOME  GROUP   A    B  ©  0  AGE UL 

INTERVIEWER'S  NAME  VE.Q  DATE    llllM. 

1.  What  brand  of  cigarettes  do  you  smoke? 

2.  How  long  have  you  been  smoking  this  brand? 

%  W^/. 

3.  Why  d6  you  smoke  this  brand? 

£J»  -for.  ta*jti..  Mi  rruU 

4.  What  brand  did  you  smoke  before  the  present  brand? 

5.  (If  former  brand  used)  Why  did  you  change"? 

6.  What  cigarette  advertising  has  impressed  you  most? 


7.  Where  did  you  see  it  advertised? 


ytjiAM 


id-cnJei 


£3/. 


Name     (^W^<,J:?n^4. 
Street  &  Number    3^^Hg^^^T> 


/-z 


Fig.  38. — The  same  cigarette  questionnaire  coded  by  editor. 

number  is  punched;  in  the  next  two,  the  city  number;  in  column  7, 
Income  group  C;  in  column  8,  sex;  etc.,  etc. 

The  card  (Fig.  39)  shows  the  questionnaire  presented  in  Fig.  38 
after  punching. 

Survey  Analysis  Sheets 

The  survey  analysis  sheets  to  which  the  findings  are  to  be 
posted  should  be  designed  during  the  phase  of  planning  and 
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before  the  survey  is  undertaken.  These  analysis  sheets  have  an 
important  bearing  on  the  form  of  the  questionnaire  and  of  the 
tabulating  card.  It  is  not  enough  to  have  only  a  general  idea  of 
the  type  of  information  desired;  in  such  an  event  it  might  be 
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Fig.  39. — Punched  card  for  consumer  cigarette  questionnaire. 

discovered  too  late  that  certain  significant  items  have  not  been 
provided  for — items  which  might  very  well  have  been  included 
at  practically  no  extra  cost.  Also,  the  availability  of  prepared 
analysis  sheets  or  forms — rather  than  merely  a  general  statement 


FORM  NO.  D 

TOTAL  NO.  QUEST.... 

OCCUPATION  OF  KtSKUNUtNl 

OCCUPATION 

MEN 

WOMEN 

TOTAL 

Number 

Per  cent 

Number 

Per  cent 

Number 

Per  cent 

Homemaker 

Business 

Student 

Other 

None 

Unknown 

TOTAL 

100.0 

100.0 

100.0 

n~ 

Fig.  40. — Example  of  an  analysis  sheet. 


of  instructions — greatly  expedites  the  tabulating  operation  of 
sorting  and  counting  and  so  reduces  the  time  and  cost  involved. 
There  is,  of  course,  a  great  variety  of  analysis  sheets,  a  few 
characteristic  examples  of  which  are  shown  in  Figs.  40  to  43 
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inclusive.     These  are  all  familiar  types  of  primary  tabulation 
forms  or  analysis  sheets.     They  are  used  for  recording  the  results 


FORM  NO.  H PER  CENT  0NLY 

totai   no   niiF^T                                                                                         PERCENTAGE  OF  FAMILY  READING 

5-13 

14-  17 

18-24 

25-29 

30-34 

35-39 

40-44 

45  AND 
OVER 

UNKNOWN 

TOTAL 

PER  CENT 
OF  TOTAL 

Mother 

Wife 

Daughter 

Other  Female 

TOTAL  FEMALE 

Husband 

Son 

Other  Male 

TOTAL  MALE 

TOTAL 

UNKNOWN 

TOTAL 

Fig.  41. — Analysis  sheet. 


FORM  NO.  J FAM|LY  SIZE 

TOTAL  NO.  QUEST 

FAMILIES  COMPRISING 

NUMBER 

PER  CENT 

2  Persons 

3  Persons 

4  Persons 

5  Persons 

6  Persons 

9 

7  Persons 

8  Persons 

9  Persons 

10  Persons 

11  Persons 

12  or  more  Persons 

TOTAL 

100.0 

Fig.  42. — Analysis  sheet. 

of  straight  counts  on  each  question.     In  Fig.  4^,  for  instance,  the 
number  of  respondents  mentioning  each  brand  would  simply  be 
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posted  in  the  "Count"   column  with  the  percentages  in  the 
unheaded  columns  to  the  right. 

A  separate  sheet  is  used  for  each  question.  This  simplifies  and 
expedites  the  posting  of  items  to  other  forms  for  cross  analysis 
and  to  general  assembly  sheets.     Then,  too,  separate  sheets  can 


INVESTIGATION: 

Question  No.           1 
Column   No         IO,  U 
CnrH  No 

Simple           □ 
Duplication  □ 
CARDS  USED 

TOTAL  CARDS 

Code 

1 

Number  of  Cards'  Used 

Rejects 

Answered  by 

Code  1 

Count 

Countl 

Count 

Count 

3ount 

Camel 

10-1 

Chesterfield 

2 

Lucky  Strike 

3 

Old  Gold 

4 

Philip  Morris 

5 

Herbert  Tareyton 

6 

Spud 

7 

Raleigh 

8 

Kool 

9 

Wines 

0 

Viceroy 

11-1 

Pall  Mall 

2 

Lord  Salisbury 

3 

Benson  &  Hedges 

4 

Murad 

5 

Others 

9 

■ 

.. 

Fig.  43. — Analysis  sheet. 

be  bound  in  a  book  or  loose-leaf  binder  as  a  convenient  and 
accessible  form  for  reference  purposes. 

Secondary  tabulation  forms — cross-reference  sheets — are  used 
in  analyzing  the  factors  involved  in  the  primary  counts.  Figure 
44,  for  example,  is  breaking  down  " Charge  Accounts"  as  to  state, 
city  and  store  departments;  and  Fig.  45  is  setting  up  the  attrib- 
utes which  respondents  ascribe  to  respective  brands  of  cigarettes. 
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Question:  14                                                                                   Report: 
Subject:    Charge  accounts                                                            Page  No: 

Table  No: 
Chart  No: 
Chart  Form: 
Cross  analyzed  by: 

Tabulation:  Card  No:                                                                     Tab'n  No: 
Codes  to  use:                                                               Tab'n  by: 

Groups: 
Terms: 

Total 

Brand  A 

Brand  B 

Brand  C 

Others 

>fum 
ber 

% 

Num- 
ber 

% 

Num- 
ber 

% 

Num- 
ber 

% 

Num- 
ber 

% 

Total  Cards: 

Rejects: 

Ans'd  by: 

States: 

Connecticut                                6] 

New  Jersey                                  62 

Pennsylvania                             62 

New  York                                      6^; 

Delaware                                      65 

Massachusetts                           66 

Maine                                             67 

New  Hampshire                           68 

Vermont                                        69 

Population 

Over  250.000                              51 

200.000   to   250.000                 52 

150.000   to  200.000                 53 

100,000    to   150,000                 54 

75,000   to   100.000                 55 

50,000   to     75.000                 56 

25,000   to     50.000                 57 

10,000   to     25.000                 58 

Under   10.000                               59 

Departments 

A                                                          291 

B                                                          ??2 

C                                                          22,3 

D                                                   ??A 

E                                                   225 

F                                                   ?■?,(? 

G                                                   297 

H                                                          22R 

I                                                       229 

WS  by: 

Computation: 

Percentages Combine  with:                  1 

Averages 

Copying: 
Omit  co 
Omit  % 
Rank_ 
Reverse 
See  note 

Done  by: 

Omit 
unt 

Combine  with: 

Ratios ,. . 

headings 

Horizontal 

Nonp 

Done  by: 

Fig.  44. — Example  of  a  secondary  tabulation  form. 
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Tabulating  Service  Bureaus 

Punch-card  equipment  is  available  for  use  on  a  rental  basis. 
Where  there  is  an  even  flow  of  work  throughout  the  year  in  reason- 
able volume,  leased  equipment  is  justified.  In  other  cases, 
particularly  where  research  jobs  are  conducted  only  occasionally, 
the  services  of  a  tabulating  organization  may  be  especially  help- 
ful. Statistical  service  bureaus  with  highly  trained  personnel 
and  modern  automatic  machines,  operated  by  the  International 
Business  Machine  Corporation  and  by  the  Recording  and  Statisti- 
cal Corporation  and  others,  are  located  in  most  of  the  principal 
cities  of  the  country.  These  bureaus  are  so  flexibly  organized 
that  they  are  able  to  handle  special  jobs  on  short  notice  at  either 
a  flat  price  or  on  a  time  basis. 

It  must  be  remembered  that  while  considerable  space  has  been 
devoted  to  this  subject  of  machine  tabulation,  its  suitability  for 
each  specific  case  is  always  to  be  determined  by  the  factors  of 
speed,  accuracy,  flexibility,  convenience,  credibility  and  cost 
which  have  already  been  referred  to  on  pages  233  to  235,  inclu- 
sive, as  governing  the  selection  of  method. 

Special  Bibliography  on  Machine  Tabulation 

Baehm,  C.  W.,  Ed.,  Practical  Applications  of  the  Punched  Card  Method  in 
Colleges  and  Universities,  Columbia  University  Press,  New  York,  1935. 
Charting  Courses,  Recording  and  Statistical  Corporation,  New  York,  1935. 


CHAPTER  XV 

PSYCHOLOGICAL  APPROACH  IN  THE  DEVELOPMENT 
OF  CONCLUSIONS1 

Interpretation,  in  marketing  research,  is  the  process  by  which 
the  results  obtained  in  one  study  are  combined  with  other  knowl- 
edge which  one  may  have,  in  order  to  arrive  at  the  true  signifi- 
cance of  the  data.  The  knowledge  so  added  may  have  been 
gained  in  other  special  studies  or  it  may  be  comprised  in  a  general 
background  of  experience.  For  psychological  interpretation  this 
background  is  the  interpreter's  existing  systematic  psychological 
knowledge. 

Psychology,  as  a  science,  is  only  in  its  infancy  and  so  little  is 
known  that  there  is  no  single  general  system  on  which  one  can 
draw  for  interpretation  in  market  research.  What  can  be  done 
is  to  group  roughly  the  different  procedures  of  psychological 
research  and  give  a  few  examples  for  each  as  to  its  importance  for 
the  market  research  student.  The  following  brief  outline  has  no 
claim  whatever  to  comprehensiveness  or  finality.  Even  the 
present  discussion  of  this  phase  of  the  subject  must  be  treated 
with  less  precision  than  was  attempted  in  the  psychological 
observations  connected  with  preceding  phases  of  research.  No 
more  could  be  attempted  here.  A  really  exhaustive  discussion  of 
the  problems  of  interpretation  would  lead  to  very  complicated 
considerations.  The  purpose  of  this  discourse,  therefore,  is 
merely  to  furnish  the  reader  with  some  incentive  for  further  study 
of  his  own — with  the  hope  of  simply  rounding  out  here  the  picture 
given  so  far. 

As  a  matter  of  expediency  in  classifying  different  procedures  of 
interpretation,  the  following  two  approaches  are  to  be  considered: 

1.  Hypothetical  Approach.  Here  the  student  is  concerned  with 
determining  the  general  structure  of  human  personality.  He 
looks  for  the  basic  instincts;  makes  hypotheses  about  the  mecha- 
nism through  which  the  adult  personality  develops  from  native 

1  This  discussion  is  interpolated  here  because  it  treats  of  the  psychological 
aspect  of  interpretation,  which  is  the  subject  of  Chap.  XVI. 
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equipment;  examines  and  classifies  the  traits  which  combine 
steadily  with  some  fundamental  types — and  so  on.  Close"  rela- 
tion to  psychiatry  is  frequent. 

2.  Descriptive  Approach.  This  is  an  approach  which  is  culti- 
vated much  more  in  Europe  than  in  America.  In  this  approach 
the  student  is  mainly  interested  in  a  careful  analysis  of  complex 
psychological  phenomena.  Introspection  plays  a  great  role. 
How  do  we  experience  our  emotions  ?  How  do  we  carry  through 
our  purposes?  What  are  the  decisive  features  in  the  objects 
which  we  like  or  dislike?  Introspection,  however,  is  not  the  only 
medium.  One  might,  for  instance,  try  to  construct  different 
"  worlds,"  such  as  the  world  of  the  adolescent  or  the  world  of  the 
primitive  mind — as  these  " worlds"  are  revealed  through  careful 
analysis  of  the  achievements,  preferences  and  forms  of  conduct 
among  adolescents  or  among  primitive  tribes.  The  main  weight 
with  the  descriptive  approach  lies  in  a  careful  analysis  of  a 
phenomenon,  as  a  basis  for  further  experimental  or  theoretical 
consequences.  In  this  approach  the  social  sciences  are  frequently 
involved. 

The  Hypothetical  Approach  in  Psychological  Market 

Research 

The  one  psychological  topic  which,  above  all  others,  has 
permeated  books  relating  to  market  research  is  the  identification 
of  the  so-called  lists  of  instincts.1  The  idea  is  that  it  might  be 
possible  to  find  in  every  human  being  a  basic  equipment  of  desires 
to  which  sales  efforts  can  successfully  be  directed.  An  approach 
of  this  sort  has  theoretically  very  definite  shortcomings :  So  many 
different  lists  of  instincts  are  possible  that  they  can  contribute 
little  toward  a  definite  understanding  of  human  activities.  From 
a  practical  point  of  view  they  may  be  useful  sometimes  in  remind- 
ing the  market  research  man  of  possibilities  which  he  might  other- 
wise overlook.  A  famous  sales  promotion  man  once  found  in 
such  a  list  the  " desire  for  being  alone."  He  was  delighted — it 
never  having  occurred  to  him  that  people  might  want  to  be  alone 
— and,  at  once,  he  drew  up  a  brilliant  advertisement  connecting 
his  product  with  this  newly  identified  desire. 

1  Bernard,  Luther  Lee,  Instincts,  Henry  Holt  &  Company,  New  York, 
1924.  This  work  contains  a  comprehensive  and  critical  survey  of  various 
lists  of  instincts. 
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The  difficulties  connected  with  arbitrary  lists  of  instincts  are 
avoided  by  those  theoretical  approaches  which  reduce  all  human 
activities  to  one  fundamental  instinct,  or  drive,  or  desire.  All  of 
the  schools  working  in  this  direction  are  more  or  less  derivatives 
of  Freud's  psychoanalysis.  An  outstanding  example  is — Adler's1 
theory  of  inferiority  complex.  His  idea  is  that  the  basic  human 
desire  is  one  for  personal  security.  In  order  to  be  secure,  people 
strive  for  dominance  of  others;  and,  as  long  as  they  are  not 
secure,  they  have  a  feeling  of  inferiority  which  accounts  for  a  great 
many  things  that  they  do.  Whether  this  theory  is  acceptable  as 
a  whole  or  not,  a  great  many  experiences  in  everyday  social  life  can 
actually  be  accounted  for  by  means  of  Adler's  system.  Here  is  an 
example  of  its  value  in  the  interpretation  of  a  market  research. 

In  a  study  of  shoe-buying  habits,  one  woman  complains  that 
she  usually  feels  inhibited  and  uncomfortable  when  buying  shoes. 
She  is  obliged  to  sit  in  her  stocking  feet,  which  leaves  her  helpless 
and  at  the  mercy  of  the  salesman.  She  also  fears  that  she  may 
have  a  hole  in  her  stocking  and  so  hesitates  to  expose  her  feet — 
which,  also,  may  be  neglected  or  deformed.  It  is  impossible  to 
get  up  and  leave,  for  she  must  first  regain  possession  of  her  old 
shoe.  Briefly,  this  lady  reported  a  definite  inferiority  complex 
when  buying  shoes.  This  is,  of  course,  the  kind  of  statement 
which  only  a  very  sophisticated  consumer  is  apt  to  make.  But 
after  the  investigator's  attention  had  been  called  to  this  feeling, 
he  went  back  to  other  interviews  and  found  there  various  distinct 
traces  of  this  inferiority  complex.  He  found  that  respondents, 
speaking  of  their  experience  with  shoe  salespeople*  often  gave  a 
tone^of  resentment  to  their  report  which  he  did  not  find  in  inter- 
views concerning  other  commodities.  For  example:  "He  always 
looked  at  my  mother  instead  of  me"— "He  seemed  to  question 
my  purchasing  power  "— "  He  glanced  disrespectfully  at  my  feet." 

Evidently,  it  is  important  to  know  that  such  a  feeling  of 
inferiority  plays  a  great  part  in  the  buying  of  shoes.  This 
accounts  partially  for  the  heavy  turnover  of  customers  in  shoe 
stores,  it  suggests  a  special  training  for  salesmen  in  this  field  and 
it  might  even  lead  to  important  innovations  in  the  arrangement 
of  shoe  stores. 

1  Dr.  Alfred  Adler,  formerly  of  the  University  of  Vienna  and  now  (1936) 
visiting  Professor  of  Psychology  at  the  Long  Island  College  of  Medicine, 
Brooklyn,  N.  Y. 
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It  is  one  of  the  features  of  the  hypothetical  approach  connected 
with  Freud  that  not  only  is  a  basic  instinct  ascribed  to  all  human 
beings,  but  definite  hypotheses  are  made  as  to  how  our  everyday 
activities  are  linked  with  that  basic  drive.  One  of  the  mecha- 
nisms brought  to  discussion  by  Freud  is  a  mechanism  of  repression. 
Freud  assumes  that  some  of  our  desires  are  not  socially  acceptable ; 
that  in  the  course  of  our  growing  up  we  repress  them  more  and 
more;  but  that  a  keener  psychological  observation  would  still  find 
traces  of  these  repressed  desires.  One  of  the  traces  might  be 
seen  in  the  little  mistakes  which  people  make.  A  man  might 
leave  a  lady  declaring  that  he  would  never  see  here  again;  but  if 
he  should  leave  his  gloves  in  her  home,  the  psychoanalyst  would 
interpret  this  instance  of  forgetfulness  as  an  evidence  of  a 
repressed  desire  to  go  back. 

A  Freudist  would  go  rather  far  with  this  concept  of  repression. 
In  a  restaurant,  for  instance,  some  people  dislike  to  have  the 
meals  for  their  partners  and  themselves  served  from  the  same 
dish.  If  both  have  ordered  French  fried  potatoes,  such  a  person 
feels  uneasy  if  the  orders  are  not  served  on  two  dishes.  The 
psychoanalyst  would  say  that  such  a  man  has  a  desire  to  get  for 
himself  everything  which  is  served  and  to  leave  nothing  for  the 
other  person;  but,  socially,  he  disapproves  of  such  an  attitude  and 
so  it  becomes  repressed;  still,  it  exists  and,  in  a  situation  which 
might  bring  it  back  to  the  surface,  the  man  feels  uneasy.  He 
tries  to  keep  on  the  safe  side  by  preferring  two  dishes  instead  of 
one.1 

An  example  linking  this  sort  of  interpretation  with  a  market 
research  problem  is  given  here  from  a  study  of  milk  consumption 
in  New  York  City.  The  general  distribution  of  milk  drinkers 
was  as  follows:  57.1  per  cent  drink  one  or  more  glasses  daily; 
7.4  per  cent  drink  less  than  a  glass  daily;  35.5  per  cent  drink  no 
milk  at  all.  The  daily  consumption  of  the  first  group  averages 
2.2  glasses.  This  result  is  very  striking.  The  expectation, 
according  to  a  general  law  of  statistical  distribution,  would  be 
that  the  second  group,  the  occasional  drinkers,  would  have  a 
frequency  somewhere  between  the  heavy  and  the  nondrinkers; 
but  it  turns  out  that  people  either  drink  a  great  deal  of  milk  or 
they  drink  none  at  all.     The  psychologist  would  be  inclined  to  see 

1  This  example  is  taken  from  the  psychoanalyst,  Erich  Fromm,  of  the 
International  Institute  for  Social  Research,  New  York. 
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here  a  very  challenging  characteristic  of  milk  consumption  and 
would  look  for  more  figures  concerning  it.  Some  confirmation 
was  found  in  two  other  points  of  the  results. 

Respondents  were  asked  how  long  they  had  been  getting  their 
milk  from  the  same  company.     The  result  was: 

Number  of  Years  Per  Cent 

1  or  less 13 

2  to  4 - 24 

5  to  9 25 

10  to  14 19 

15  or  more 21      » 

The  median  for  this  table  is  seven  years.  That  is  rather  a  long 
time,  compared  with  other  commodities,  and  it  shows  again  that, 
apparently,  once  people  have  taken  a  stand  in  the  milk  market, 
they  are  not  likely  to  shift. 

Finally,  the  adults  who  drink  milk  were  asked  if  they  had  ever 
stopped  drinking  milk  and  at  some  later  period  resumed  it  or  if 
they  had  kept  on  drinking  milk  uninterruptedly  since  childhood. 
It  was  found  that  almost  all  the  milk  drinkers  were  continuous 
drinkers.  People  who  once  stopped  drinking  milk  very  seldom 
came  back  to  it. 

It  appears  again,  therefore,  that  habits  of  milk  consumption 
have  an  element  of  constancy  and  are  little  subject  to  change.  It 
might  be  that  these  data  are  best  interpreted  by  the  concept  of 
"repression"  in  somewhat  this  manner:  Milk  is  closely  connected 
with  early  childhood  experiences,  which  are  most  apt  to  be 
repressed  because  all  the  desires  operative  at  this  phase  are  still 
"unsociaJized."  Many  people,  therefore,  might  keep  away  from 
any  change  of  their  milk-drinking  habits  in  order  not  to  come  too 
near  those  repressed  realms  of  their  past  experience.  It  is  the 
same  idea  which  makes  it  repugnant  to  the  man  of  the  preceding 
example  to  have  food  for  two  served  from  one  dish. 

If  such  an  interpretation  be  correct,  then  it  has  immediate 
application  to  the  promotion  of  milk.  It  would  indicate  that 
probably  not  much  good  would  be  done  by  repeating  rational 
statements  on  the  dietary  values  of  milk.  It  would  show  the 
necessity  of  an  emotional  appeal.  But  not  every  emotional 
appeal  would  do,  because  many  of  them  might  strengthen  the 
repression  rather  than  relieve  it.  Great  care  would  be  necessary 
in  the  selection  of  the  appeal,  but  that  is  a  practical  question 
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which  requires  no  further  treatment  here.  At  this  point  only  its 
difficulties  need  be  stressed. 

Psychoanalytical  ideas  have  been  used  repeatedly  as  a  basis 
for  the  statement  that  modern  psychologists  know  exactly  what 
makes  people  buy  and  are  therefore  able  to  solve  all  the  problems 
of  marketing.  That  proficiency  has  not  yet  been  reached,  but, 
what  is  here  called  the  hypothetical  approach  is  a  definitely 
progressive  step  in  the  field  of  psychology.  We  are  still  far  from 
general  solutions,  however,  and  ought  to  be  very  happy  if,  in  some 
special  cases,  we  are  able  to  see  farther  and  more  clearly  and  to 
deduce  more  practical  conclusions  than  were  possible  a  few 
decades  ago. 

Mention  should  be  made  here  of  one  example  of  the  typological 
efforts  which  have  been  made  recently:  the  distinction  between 
extrovert  and  introvert  types.  Coming  from  psychiatry,  the 
idea  has  been  worked  out  that  there  are  two  main  reactions  of 
personalities 'toward  the  problems  of  life.  The  extrovert  type  gets 
along  easily  with  people,  is  not  too  strict  about  details,  rarely 
holds  a  radical  view  in  any  respect,  is  an  optimist,  not  too  con- 
scientious or  reliable.  The  introvert  type  is  just  the  opposite. 
Such  a  person  finds  it  difficult  to  change  his  views,  is  not  very 
susceptible  to  the  stimuli  which  come  to  him  from  his  environ- 
ment, is  rigid  in  all  of  his  requirements.  There  is  some  evidence 
that  both  types  are  different  in  physique  also ;  the  extrovert  being 
inclined  to  be  stouter,  smoother  in  his  movements  and  more  genial 
in  his  behavior;  the  introvert  more  probably  having  sharp 
features,  bony  physique  and  harsh  movements.  Many  tests  have 
been  developed  to  distinguish  between  these  two  types.  They 
pertain  to  a  great  variety  of  items :  how  people  pour  water  into  a 
glass;  how  they  have  behaved,  as  children,  to  their  friends;  what 
philosophy  they  hold  now  in  regard  to  life;  and  many  others. 

It  is  not  yet  clear  whether  or  not  these  and  other  types  will  be 
useful  in  market  research.  It  is,  however,  certainly  worth  while 
to  try  to  turn  them  to  account.  An  example  can  be  given  in 
connection  with  a  study  of  women's  attitude  toward  rayon. 
Included  in  the  survey  was  an  extrovert-introvert  test.  This 
developed  evidence  which  seemed  to  show  that  the  introverts  are 
more  reluctant  to  accept  rayon  than  the  extroverts.  This  could 
be  readily  understood  from  the  psychological  meaning  of  these 
two  types ;  because  extroverts  are  more  susceptible  to  new  influ- 
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ences  than  are  introverts.  If  the  results  were  reliable,  then  some 
interesting  practical  consequences  should  naturally  follow:  The 
main  effort  of  advertising  should  then  be  directed  toward  intro- 
vert consumers;  introvert  people  according  to  the  definition 
would  probably  be  more  easily  won  by  explicit  arguments  than 
by  emotional  appeals.  Such  distinctions  as  these  would  lead  the 
promotion  of  rayon  into  very  definite  channels — probably  with 
some  noticeable  improvement  in  effectiveness. 

It  is  characteristic  of  all  the  interpretations  discussed  in  this 
section  that  they  assume  some  very  general  rules  to  be  existent  in 
the  field  of  psychology.  By  linking  actual  results  with  concepts 
such  as  inferiority  complex,  repression,  extroversion,  the  inter- 
preters draw  their  conclusions  from  all  of  the  implications  of  their 
concepts.  That  is  justified  scientific  procedure.  But,  so  far, 
very  few  such  concepts  have  been  definitely  established,  and  for 
the  majority  of  current  problems  one  has  to  draw  on  more  modest 
knowledge,  which  does  not  try  to  cover  the  whole  realm  of  human 
behavior.  Such  are  the  interpretations  which  are  now  to  be 
considered. 

The  Descriptive  Approach  in  Psychological  Market 

Research 

Close,  quick  and  sure  observation  of  details  and  a  readiness  in 
recognizing  their  significance  are  generally  characteristic  of  the 
psychological  attitude.  The  way  a  man  enters  a  room,  the  speed 
or  hesitation  with  which  he  makes  a  remark,  the  books  he  looks 
at  first  when  he  approaches  a  shelf — all  of  these,  to  the  psycholo- 
gist, offer  indices  of  a  man's  aims,  problems  and  habits.  This  is 
just  the  technique  the  psychologist  uses  in  the  descriptive 
approach  in  market  research.  In  any  marketing  study  he  will 
observe  the  widest  possible  range  of  details;  taking  no  result  at  its 
face  value,  he  will  try  to  find  out  what  psychological  meaning 
each  item  has;  and  he  will  look  at  each  result  not  alone  in  its 
isolation,  but  in  combination  with  as  many  others  as  possible. 
It  is  along  these  three  steps  of  descriptive  approach  that  some 
examples  will  now  be  given  without  attempting  any  general 
statements. 

Observing  Details.  Why  should  anyone  be  better  equipped 
to  know  the  details  of  a  business  than  the  owner — the  business- 
man himself?     This  is  an  argument  frequently  advanced  against 
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any  professional  market  research.  There  seems  to  be,  however, 
something  like  a  specific  blindness  of  the  expert  in  his  own  field. 
He  is  so  set  toward  a  certain  trend  of  activity  that  he  overlooks 
important  items.  Some  time  ago,  for  example,  experiments  were 
made  by  psychologists  regarding  the  "feel"  of  rayon.  It  turned 
out  that  the  modern  rayons  are  so  soft  to  the  touch  that,  blind- 
folded, subjects  could  not  distinguish  them  from  costly  silks  and,  in 
tests,  frequently  gave  rayon  an  emphatic  preference.  About  the 
same  time  that  these  tests  were  being  made,  a  large  rayon  com- 
pany held  an  exhibition  of  dresses  in  a  fashionable  New  York 
center.  Each  dress  bore  a  conspicuous  tag — "Don't  touch." 
Here,  out  of  a  traditional  thriftiness,  the  manufacturer  was 
depriving  himself  of  his  best  selling  point — the  soft  touch  of  his 
fabrics.  It  would  probably  have  been  much  more  profitable  to 
that  manufacturer  to  have  replaced  every  dress  soiled  by  touch 
rather  than  to  have  deprived  all  the  prospective  buyers  of  the 
delight  of  feeling  the  softness  of  the  fabric. 

In  the  milk  study  previously  mentioned,  it  turned  out  that  at 
between  ten  and  fifteen  years  of  age  people  are  most  likely  to  stop 
drinking  milk.  One  of  the  reasons  boys  stop  has  been  mentioned 
before;  they  feel  that  milk  drinking  is  "sissy."  Milk  becomes 
to  them  the  symbol  of  their  childhood  and  in  their  eagerness  to 
grow  up  they  begin  to  dislike  milk.  In  spite  of  this,  almost  all 
of  the  big  milk  companies  advertise  milk — perversely — from  the 
baby's  point  of  view.  Every  boy  riding  on  a  street  car  anywhere 
in  the  whole  country  gets  it  rubbed  into  him  that  milk  is  a  baby's 
food.  No  wonder  he  abandons  milk.  Nowhere  is  any  planned 
provision  made  against  the  specific  psychological  attitude  of 
those  ages  which  are  decisive  for  the  consumption  of  milk  among 
adults.1 

Perceiving  the  General  Psychological  Implications  in  Single 
Items.  On  page  204  is  given  a  list  of  occasions  on  which  house- 
wives in  Vienna  were  prompted  to  send  out  their  laundry.  Each 
of  these  different  occasions  could  be  taken  separately  as  the  basis 
for  a  distinct  selling  appeal.  For  example,  some  copy  might  be 
written  first  on:  "When  you  give  up  your  maid,  send  out  your 

1  This  analysis  led  to  practical  action.  One  of  the  big  milk  companies, 
to  which  the  referred  study  was  submitted,  has  since  then  put  on  a  special 
radio  program  for  boys;  a  highly  popular  football  coach  was  put  on  the 
air  as  a  promoter  of  milk  drinking. 
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laundry,"  because  that  item  appeared  most  frequently  among  the 
replies.  The  next  copy  might  be  on  "  When  you  get  a  baby,  send 
out  your  laundry,"  because  that  has  the  next  highest  frequency 
figure.  So  the  whole  list  of  occasions  could  be  gone  through.  But 
all  of  these  items  have  a  common  psychological  denominator. 
They  are  all  episodes  of  emergency.  Apparently,  only  in  such 
situations  are  conservative  housewives  willing  to  make  a  trial 
with  the  laundry  company — although  many  continue  to  send 
out  their  washing  after  the  first  trial  has  been  made. 

It  was  this  psychological  generalization  of  the  special  results 
which  led  the  sponsor  of  this  Laundry  study  into  a  somewhat 
ghoulish  but  successful  undertaking.  He  figured  out  that  the 
most  devastating  " emergency"  in  life  is  death.  Therefore,  he 
procured  the  death  lists  at  a  city  hall  and  wherever  in  a  family  a 
woman  died  he  wrote  a  letter  commiserating  with  the  family, 
pointing  out  how  the  deceased  liked  to  do  the  laundry  herself 
and  implying  that  it  might  be  a  help  to  the  family  if  the  company 
now  took  over  this  work.  The  campaign  was  highly  successful. 
But  here  is  the  important  point:  The  campaign  was  not  suggested 
directly  by  the  study;  it  was  made  possible  only  by  the  adequate 
psychological  interpretation  of  the  results. 

Another  example  was  connected  with  a  tea  study.  On  the 
European  continent  not  a  great  deal  of  tea  is  drunk.  A  survey 
recorded  the  different  situations  in  which  tea  drinkers  had  begun 
to  take  on  this  habit.  Instead  of  a  simple  listing  of  the  different 
items,  the  common  psychological  denominator  was  sought.  It  was 
found  then  that  at  special  turning  points  of  their  lives  people 
seemed  most  likely  to  change  their  drinking  habits:  After  leaving 
college,  when  they  made  their  first  trip,  after  getting  married— 
at  such  moments  they  seemed  most  susceptible  to  suggestions 
pertaining  to  new  beverages.  Here,  again,  the  practical  con- 
sequences are  evident. 

The  general  advice  to  be  deduced  from  such  studies  is  that  when 
one  has  a  special  result  it  is  well  always  to  ask:  "  What  does  this 
mean  psychologically?"  Sometimes  it  is  not  possible  to  give  the 
meaning  in  one  or  two  words  but  it  is  there  nevertheless  and  it  is 
important  to  be  aware  of  that  fact.  In  the  study  mentioned  on 
page  67  the  attitude  of  people  toward  the  food  value  of  milk  was 
obtained  by  asking  them  which  they  felt  to  be  more  nourishing- 
milk  or  one  of  four  other  foods  considered  in  physiologically 
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equivalent  amounts.  The  result  of  this  question  showed  that 
people  estimated  the  food  value  of  milk  to  be  higher  than  the 
physiologically  equivalent  amount  of  string  beans  and  potatoes; 
but  they  underestimated  the  value  of  milk  as  compared  with  eggs, 
and;  most  heavily,  as  compared  with  beefsteak.  Psychologically, 
what  does  this  mean?  Evidently  there  is  a  tendency  to  feel  that 
milk  is  a  weak  food.  It  seems  to  compare  favorably  with  vege- 
tables but,  when  it  comes  to  meat,  the  traditional  token  of 
strength,  milk  is  taken  much  less  seriously  than  it  deserves. 
Here,  there  is  no  such  convenient  word  as  "emergency"  or 
"  turning  point,"  but  a  good  research  man  could  point  out  clearly 
the  practical  consequences  of  the  psychological  interpretation 
implied  in  this  result. 

Interpreting  Several  Results  Simultaneously.  Underlying  all 
interpretations  is  a  sort  of  assumption  to  the  effect  that  behind 
every  result  there  is  something  more  important  than  the  result 
itself.  Or,  to  put  it  more  professionally,  the  interpreter  general- 
izes the  special  items  in  order  to  get  at  their  psychological  meaning. 
This  procedure  presupposes  that  what  a  single  individual  or  a 
whole  group  does  in  buying  a  commodity  is  an  outgrowth  of  a 
more  deeply  rooted  psychological  attitude.  This  more  general 
attitude  will  also  be  exhibited  in  other  items  than  the  special  one 
under  discussion.  If,  for  instance,  there  really  is  a  feeling  of 
inferiority  that  accounts  for  people's  attitude  toward  shoe  sales- 
men, signs  of  it  should  be  found  in  other  phases  of  the  shoe  pur- 
chase also.  And,  of  course,  they  are.  They  are  found,  for 
example,  when  observing  customers  as  their  shoes  are  taken  off  by 
«  the  salesmen.     The  first  movement  is  usually  a  characteristic 

withdrawal  of  the  foot  beneath  the  chair  on  which  the  customer 
is  sitting;  only  after  some  hesitation  is  the  foot  put  back  on  the 
footstool. 

In  this  same  way  it  could  be  shown,  in  all  of  the  other  interpre- 
tations, that  when  a  good  inference  has  been  made  as  to  an  under- 
lying psychological  situation,  it  is  always  corroborated  in  other 
parts  of  the  study.  At  this  point  the  consideration  can  be 
reversed  to  arrive  at  the  following  rule:  If  a  good  interpretation 
is  desired  coordinate  as  many  results  as  possible.  This,  because 
the  larger  the  basis  of  data  from  which  the  interpreter  proceeds, 
the  more  likely  is  his  psychological  analysis  to  be  correct  and 
productive. 
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This  point  is  made  clear  by  a  rather  elaborate  example  drawn 
from  a  study  of  the  men's  ready-made  clothing  market.  Among 
others,  the  three  following  questions  were  asked : 

1.  What  factors  are  important  in  a  good  suit? 

2.  What  factors  played  a  part  in  the  actual  selection  of  the  last  suit 
bought? 

3.  What  difficulties  developed  during  the  wearing  of  the  suit? 

The  main  replies  are  tabulated  simultaneously  in  the  following 
table : 


Characteristic 

General 

requirement, 

per  cent 

Last 
purchase, 
per  cent 

Difficulty 

in  wearing, 

per  cent 

Quality1 

39 

41 

15 

5 

21 
36 
25 

18 

58 

Fit   

33      < 

0 

Price 

9 

100 

100  . 

100 

1  See  comments  on  the  item  " quality,"  in  Chap.  Ill,  page  76. 

It  is  obvious  that,  as  a  general  requirement,  the  matter  of 
quality  is  of  relatively  great  importance;  but,  during  the  course 
of  the  purchase,  one  is  not  in  a  position  to  pass  judgment  on  the 
quality  and  hence  falls  back  upon  more  superficial  characteristics, 
such  as  a  pleasing  pattern  or  color — only,  subsequently,  in 
disappointment,  to  experience  the  difficulty  in  wearing  which  con- 
cerns the  problem  of  " quality' '  all  over  again.  Here  interpreta- 
tion is  already  involved.     But  more  data  are  available. 

In  conversations  with  respondents  about  the  clothing  salesmen, 
it  was  found  that  they  want  the  salesman  to  be,  above  everything 
else,  dependable  in  his  statements,  earnest  and  consistent.  This 
is  very  different  from  the  " keep-smiling"  qualification  required 
in  the  selling  of  some  other  commodities. 

Finally,  when  asked  their  reasons  for  the  choice  of  the  store, 
almost  half  of  the  respondents  replied— "  recommended  by 
others.''  This,  again,  far  surpasses  the  importance  of  such  a 
group  of  answers  in  other  market  surveys. 
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Now,  all  these  points  can  be  combined  in  the  following  state- 
ment: In  buying  ready-made  clothes,  there  is  a  special  difficulty 
involved  in  recognizing  the  quality  of  a  fabric,  although  much 
importance  is  attached  to  it.  So,  the  whole  purchase  becomes  a 
problem  of  confidence — the  dependable  store,  the  dependable 
salesman.  The  attitude  of  the  group  of  men  questioned  about 
clothes  buying,  therefore,  was  determined  by  the  wish  to  solve 
the  problem  of  confidence  involved  in  that  type  of  transaction.1 

Every  study  confronts  the  student  with  a  new  problem.  He 
has  to  think  over  the  matter  in  each  case  anew.  In  all  cases, 
however,  he  will  find  how  helpful  it  is  to  use  this  rule :  Try  as  hard 
as  possible  to  find  several  sections  of  the  results  which  permit  a 
joint  psychological  interpretation.  The  student  may  be  sure 
then  that  he  is  nearest  those  features  of  the  whole  problem  which 
are  psychologically  most  important.  It  is  possible,  of  course,  to 
find  cases  in  which  nothing  fits  together.  In  these  cases  the  close 
attention  to  details  and  the  carrying  out  of  the  general  psychologi- 
cal implications  in  the  single  items  must  be  relied  upon  to  make 
the  whole  material  psychologically  significant.  But,  in  no  case 
should  the  efforts  at  joint  interpretation  be  abandoned  too 
readily. 2 

Statistical  Presentation  of  Psychological  Results 

This  discussion  would  not  be  complete  without  a  few  observa- 
tions on  the  way  psychological  results  ought  to  be  presented 
statistically.     In  the  discussion  of  the  requirement  of  articulate 

1  The  interpretation  of  these  data  in  an  actual  case  led  to  an  immediate 
consequence.  The  manufacturer  was  advised  to  introduce  a  series  of 
devices  in  his  stores  which  would  transform  them  from  the  ordinary  tailoring 
shop  into  a  sort  of  laboratory  for  clothing  engineering.  This  he  did  by 
displaying  pictures  which  showed  how  the  materials  had  been  woven,  small 
machines  which  tested  the  material's  resistance  to  wear  and  various  other 
demonstrations;  and  his  enterprise  achieved  considerable  success. 

2  In  discussing  the  techniques  in  interpretation  a  comment  by  Arthur  W. 
Kornhauser  is  pertinent  here.  "All  such  suggestions,  of  course,  are 
hypotheses;  they  are  guesses  to  be  checked  upon.  Evidence  is  collected 
to  show  the  truth  or  falsity  of  each.  But  unless  one  has  these,  and  many 
additional,  possible  interpretations  in  mind,  there  is  little  likelihood  that 
he  will  discover  significant  evidence  at  all.  The  more  plausible  and  com- 
prehensive the  preliminary  interpretations,  the  greater  the  probability  of 
arriving  at  a  sound,  practically  useful  understanding  of  the  buying  in 
question." 


APPROACH  IN  THE  DEVELOPMENT  OF  CONCLUSIONS    279 


classification  it  was  pointed  out  that  this  not  only  serves  a 
scientific  purpose  but  makes  the  reading  easier.  The  relation 
between  sound  psychology  and  sensible  statistical  treatment  is 
referred  to  repeatedly.  Suggestions  for  good  interpretation 
ended  with  an  appeal  for  joint  treatment  of  several  data  at  the 
same  time.  It  is  interesting  to  see  how  certain  statistical 
techniques  lend  themselves  to  this  idea. 

Suppose,  for  instance,  that  people  should  be  asked  which 
motion  picture  actress  they  like  best  and  which  one  they  like 
least.  An  interesting  difficulty  would  at  once  arise.  Certain 
actresses,  as  for  instance,  Greta  Garbo,  would  be  most  frequently 
mentioned  among  the  preferences — as  well  as  among  the  dislikes. 
The  matter  is  easily  interpreted:  Even  if  the  majority  approve  of 
her,  an  actress  who  is  much  discussed  is  very  likely  to  meet  with 
more  unfavorable  comments  than  the  actress  who  is  little  liked 
but  not  so  frequently  discussed.  There  seems  to  be  a  distinction 
between  fame — which  simply  implies  being  discussed,  irrespective 
of  the  content  of  the  comments,  and  popularity — which  depends 
upon  the  proportion  of  favorable  items  among  all  the  comments  an 
actress  receives.  Why  not  put  that  directly  into  statistical 
indices?  Let  us  add  all  of  the  comments  made,  irrespective  of 
content,  and  call  it  an  "index  of  fame."  Then  let  us  compute  the 
ratio  of  favorable  over  unfavorable  comments  and  call  that  an 
"index  of  popularity." 

Such  a  procedure  is  always  of  great  importance  in  market 
research  where  it  is  desired  to  distinguish  between  the  frequency 


Characteristics 

Negative 

comments 

per  100 

positive 

Per  cent 

of  all 
comments 

Price  .       

81 
56 
54 
53 
42 
27 
22 
50 

18.1 

Fit  of  shoe 

11.0 

Quality  of  shoe 

27.0 

10.8 

5.0 

General  judgments 

21.3 

5.5 

1.3 

100.0 
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with  which  a  topic  is  discussed  and  the  mood  in  which  it  is  com- 
mented upon — the  latter  being  measured  by  the  ratio  between 
favorable  and  unfavorable  comments.  In  one  study,  house- 
wives gave  their  opinions  about  the  leading  shoe  stores.  Their 
judgments  are  summarized  in  the  table  on  page  279.  The  first 
column  gives  the  number  of  negative  comments  per  hundred 
positive  comments  and  corresponds  to  the  "index  of  popularity  " 
just  referred  to;  the  second  column  gives  the  per  cent  number 
of  comments  irrespective  of  their  positive  or  negative  character 
and  corresponds  to  the  previously  mentioned  "index  of 
fame." 

It  is  interesting  to  see,  for  instance,  that  price  is  not  frequently 
mentioned  but,  when  it  is  mentioned,  the  comments  are  more 
negative  than  on  any  other  item.  The  quality  of  shoes  is  men- 
tioned most  frequently  but  in  a  rather  favorable  way — two  out  of 
three  comments  being  favorable. 

Especially  if  a  comparison  of  different  groups  of  judgments  is 
involved,  as  judgments  about  various  stores,  judgments  from  men 
and  women,  judgments  from  hearsay  or  on  the  basis  of  experience 
— this  method  constitutes  an  impressive  tool  of  interpretation. 

Another  case  in  which  it  is  psychologically  helpful  to  combine 
several  results  in  one  index  arises  when  people  are  asked  ques- 
tions which  require  the  answers,  "more,"  "less"  or  "equal."  In 
a  previously  quoted  example,  the  problem  was  to  ascertain 
whether  a  glass  of  milk  is  regarded  as  more,  less  or  equally 
nourishing  when  compared  with  two  eggs,  for  instance.  The 
index  which  best  suits  the  psychology  of  this  question  is  to  take 
the  people  who  say  "more,"  subtract  the  people  who  say  "less" 
and  divide  the  difference  by  the  number  of  all  the  respondents — 
including  those  who  say  "equal."  Such  an  index  varies  between 
minus  one  and  plus  one  according  to  the  relative  number  of  dis- 
senters and  consenters;  it  is  near  zero  when  they  balance  each 
other  or  when  the  number  of  neutral  statements  is  excessive. 
Here  is  a  more  explicit  example: 

In  1932,  all  the  registered  radio  listeners  in  Austria  were  ques- 
tioned by  the  Federal  Broadcasting  Station  as  to  which  of  fifty 
listed  items  they  would  like  to  hear  more,  equal,  or  less  time  on 
the  air  than  was  then  being  given.  The  following  table  shows 
those  programs  which  were  most  negatively  and  most  positively 
judged  according  to  the  type  index  just  described. 
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Types  of  presentation  most  strongly 
disliked  by  Viennese  men 

1 .  Chamber  music —  70 

2.  Choral  concerts —  52 

3.  Literary  lectures —51 

4.  Symphony  concerts —19 

5.  Women  topics —49 

6.  Concert  academics —40 

7.  Organ  concerts —38 

8.  Literary  materials —35 

9.  Practical  tips  for  house- 
wives   —34 

10.  Farming  talks —33 

11.  History  of  art  and  music .  —31 

12.  Theater  and  art  critique . .  —30 


Programs  most  desired 
by  Viennese  men 

A.  Gay  evenings 77 

B.  Light    entertainment,    con- 
certs      58 

C.  Comedy 53 

D.  Viennese  evenings 49 

E.  Folk  plays 46 

F.  Geography 44 

G.  One-act  plays 51 

H.  Phonograph  records 27 

I.  Operettas 24 

J.  Reports  of  folkways 23 

K.  Lectures  on  science 21 

L.  Lectures    with    phonograph 
records 21 

M.  Current  topics 17 


The  rejected  themes  evidently  fall  into  three  groups : 

a.  Serious  music  (1,  2,  4,  6,  7) 

b.  Theoretical  discussions  about  art  (3,  8,  11,  12) 

c.  Themes  not  actually  in  realm  of  respondent — women,  farming  (5,  9,  10) 

The  most  favored  programs  also  comprise  three  groups : 

a.  Light  music  (B,  D,  I,  presumably  H) 

b.  Light  literary  programs  (A,  C,  E,  G) 

c.  Matters  presumably  characterized  by  being  unusual  (F,  J,  K,  L,  M) 

This  study  presented  a  splendid  opportunity  for  the  joint 
psychological  interpretation  of  a  great  amount  of  data.  The 
whole  content  of  the  foregoing  table  was  summarized  in  the 
following  statement: 

In  music,  as  well  as  in  literary  programs,  the  serious  type  is 
avoided ;  the  lighter  type  is  preferred.  The  attitude  toward  music 
is  both  positively  and  negatively  a  more  definite  one  than  that 
toward  literature.  The  attitude  toward  factual  programs  is 
most  indefinite;  still,  features  with  unusual  or  "sensational" 
content  are  preferred  above  the  more  speculative  or  educational 
talks.  All  of  these  conclusions  are  clearly  traceable  through  the 
statistical  index. 
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CHAPTER  XVI 
INTERPRETATION 

(As  Presented  in  Chart  H) 

Interpretation,  as  is  now  clear,  consists  in  appraising  the  data 
gathered  in  a  research  project  in  terms  of  the  desired  objectives 
and  of  stating  the  conclusions  reached  through  this  appraisal 
process.  It  is,  consequently,  more  a  subjective  process  than  a 
method  or  a  series  of  definite  procedures  that  can  be  enumerated 
or  listed.  It  is  the  light  of  intelligence  playing  upon  the  assembled 
facts  and  giving  them  significance.  Its  validity  depends  more 
upon  the  common  sense,  experience,  background,  knowledge  and 
intellectual  honesty  of  the  interpreter  than  upon  conformity  to 
any  set  rules  that  may  be  formulated. 

Interpretation  not  only  in  a  very  important  sense  determines 
the  ultimate  value  of  the  whole  project,  but  it  accompanies 
practically  every  stage  of  the  research  program.  In  the  prepara- 
tory stages  those  decisions  which  are  made  in  defining  the  scope 
of  the  investigation,  in  determining  the  extent  of  sample  studies  or 
surveys  and  in  setting  up  tests  of  value  of  the  data  are  all  inter- 
pretative judgments.  They  all  anticipate  and.  contribute  to  the 
development  of  the  tentative  and  final  conclusions.  Similarly,  in 
the  processes  of  collecting  and  organizing  the  data,  every  decision 
for  retaining  or  rejecting  particular  items  of  information  has  in  it 
the  elements  of  the  appraisal  function. 

In  general,  these  earlier  decisions  are  tentative.  They  are 
subject  to  frequent  and  radical  adjustments  as  the  volume  of 
data  grows  and  new  implications  arise.  But  they  represent  a 
more  or  less  continuous  eclectic  exercise,  culminating  in  the 
ultimate  and  inclusive  interpretation  of  the  entire  body  of  data. 

The  interpretative  function  is  quite  intimately  bound  up,  of 
course,  with  Stage  IV,  Organization  of  Data;  it  accompanies  all 
the  steps  of  that  stage  and  is  so  closely  intertwined  with  organiza- 
tion procedure  that  the  two  processes  may  very  well  appear  as 
being  merely  the  subjective  and  the  objective  aspects  of  a  single 

series  of  actions. 
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These  two  processes  need  not  necessarily  be  executed  by  the 
same  person.  In  many  cases  this  would  be  impracticable.  Inter- 
pretation requires,  rather,  that  the  judgment  which  is  to  evolve 
tentative  and  final  conclusions  must  be  brought  to  play  upon 
every  step  of  the  organization  process.  This  continuity  of  the 
interpreter's  interest  is  essential  to  the  end  that  the  data  to  be 
presented  may  be  something  more  than  a  census — like  a  compila- 
tion of  reference  material;  that  they  shall  be  selected  and 
arranged  in  a  sequence  that  will  clearly  support  the  conclusions; 
and  that  they  may  carry  conviction  by  reason  of  effective  state- 
ment and  presentation. 

The  interpreter,  if  not  himself  engaged  in  organizing  the  data, 
should,  therefore,  hold  frequent  conferences  with  all  those  who  are 
actually  doing  the  work  and  should  keep  himself  closely  informed 
on  every  detail  of  the  procedure  followed  in  all  the  preceding 
phases  of  the  study.  Sound  and  practical  interpretation  may  and 
often  does  require  radical  changes  in  arrangement  or  method  and 
may  sometimes  even  necessitate  a  complete  reorganization  of  the 
material  in  a  manner  better  suited  to  the  exposition  of  the  final 
conclusions.  Safely  to  arrive  at  such  important  decisions,  a  com- 
prehensive view  of  the  whole  work  is  manifestly  essential. 

Interpretation  is  also  intimately  related  to  the  phase  which 
follows  it — Stage  VI,  Presentation  of  Results.  In  fact,  Inter- 
pretation is  the  basic  factor  determining  much  of  the  character 
and  effectiveness  of  the  Presentation  which  is  to  be  developed 
from  the  study. 

Interpretation,  for  instance,  largely  determines  the  scope  of 
the  presentation.  It  is  in  the  interpretative  phase  of  the  work 
that  the  meaning  of  the  data  is  extracted.  It  then  becomes 
apparent  what  truths  have  been  established  with  respect  to  the 
objectives,  what  implications  have  arisen,  what  inferences  may  be 
drawn  and  what  significant  relationships  have  been  disclosed. 
All  of  this  is  the  raw  material  for  the  presentation.  The 
plentitude  or  paucity  of  that  material  must  necessarily  control 
the  breadth  or  scope  of  the  presentation.  Certainly  no  presenta- 
tion can  have  any  greater  range  or  substance  than  the  raw  mate- 
rial affords. 

In  this  interpretative  stage,  too,  the  values  of  the  various  items 
of  information  are  fixed  and  some  estimate  of  their  relative  bearing 
on  the  problem  arrived  at.     In  practice,  the  material  emerging 
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from  the  hand  of  the  interpreter  is  generally  found  arranged  in 
more  or  less  the  sequence  or  order  in  which  it  finally  appears  in 
the  presentation.  It  will  usually  be  found,  too,  that  the  argu- 
ments, points  or  features  given  first  importance  in  the  interpreta- 
tive stage  are  those  which  warrant  and  receive  tne  strongest 
emphasis  in  the  final  presentation. 

Since  the  interpretative  process  is  subjective,  it  is  in  this  stage 
that  personal  judgment,  bias  and  human  fallibility  may  enter — to 
make  or  mar  the  value  of  the  whole  research  project.  No  matter 
how  voluminous  the  material  may  be  or  how  attractive  its  pres- 
entation, unsound,  immature  or  superficial  judgment  cannot 
produce  sound  concjusions.  There  is  always  present  the  tempta- 
tion to  prove  too  much,  or  to  make  sweeping  and  positive  state- 
ments on  the  basis  of  partial  proof;  to  construct  statistical 
dinosaurs  out  of  a  few  toe  bones  by  the  use  of  a  large  measure  of 
promotional  imagination.  The  instance  cited  in  The  New  Yorker 
of  the  gentleman  who  stated  flatly — on  the  basis  of  questioning 
200  " typical  persons" — that  1,267,594  New  Yorkers  sleep  nude 
would  seem  to  be  a  case  of  making  very  meager  data  go  a  very 
long  way. 

Another  frequent  source  of  misinterpretation  arises  from  the 
tendency  to  apply  criteria  of  judgment  that  are  valid  in  one  field 
of  marketing  to  another  field  in  which  they  do  not  hold.  This 
often  happens,  for  instance,  when  investigators  thoroughly 
familiar  with  consumer  marketing  turn  to  making  studies  for 
industrial  markets  or  markets  for  durable  goods,  such  as  construc- 
tion. In  such  markets  buying  factors,  methods  of  distribution 
and  processes  of  effecting  sales  are  very  different  from  those  found 
customarily  in  the  consumer  field.  Too  often  are  the  methods  of 
marketing  chewing  gum  or  bacon  assumed  to  apply  to  the  market- 
ing of  machinery  or  building  materials. 

Appropos  of  the  difference  between  these  two  types  of  market- 
ing, Dr.  Reed1  has  brought  together  the  following  interesting  list 
of  distinctions: 

There  are  naturally  many  ways  in  which  the  industrial  market  as  a 
whole  differs  from  the  consumer  market.  A  number  of  these  special 
characteristics  are  listed  below.  All  do  not  apply  in  equal  degree 
to  all  types  of  markets.     In  so  far  as  the  differences  between  con- 

1  Reed,  Dr.  Vergil  D.,  Advertising  and  Selling  Industrial  Goods,  Ronald 
Press  Company,  New  York,  1936. 
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sumer  and  industrial  markets  can  be  reduced  to  general  terms,  the 
more  important  follow: 

1.  Most  industrial  markets  tend  to  localize  into  a  few  well-defined 
geographical  areas  of  fairly  dense  concentration.  Within  these  few 
areas  wiljbe  found  quite  often  over  90  per  cent  of  the  logical  prospects. 
Those  outside  these  areas  can  be  profitably  cultivated  only  through 
advertising  and  correspondence  in  many  cases.  Contrast  the  widely 
scattered  consumer  market. 

2.  The  number  of  industrial  buyers  is  relatively  small  but  the  size  of 
purchases  is  relatively  great. 

3.  Several  individuals,  and  often  several  groups,  are  involved  in  the 
decision  as  to  purchases,  types  and  grades,  source  of  supply,  ordering 
and  acceptance  of  industrial  goods.  This  often  involves  long  periods 
of  negotiation  and  cultivation  by  the  seller  before  making  a  sale. 

4.  The  primary  producer  is  in  closer  contact  with  the  user  of  his  goods 
than  is  usually  true  of  the  manufacturer  of  consumer  goods  selling 
through  regular  channels. 

5.  Industrial  customers  are  experienced  and  trained  buyers  often  apply- 
ing elaborate  testing  facilities  and  exact  specifications  in  choosing 
goods. 

6.  Comparisons  of  several  sources  of  supply  are  usual  before  purchase 
is  made. 

7.  Individual  prospects  are  much  more  readily  located  and  kept  in 
touch  with  than  is  possible  with  consumers. 

8.  Individual  industrial  markets  are  usually  more  clearly  defined  and 
definitely  measurable  than  is  any  part  of  the  consumer  market. 

9.  Reciprocal  buying — you  buy  from  me  and  I'll  buy  from  you- — is  very 
common  and  constantly  a  problem. 

10.  Rational  appeals  are  most  effective  in  the  industrial  market  while 
emotional  appeals  are  by  far  most  effective  in  the  consumer  market. 

11.  The  industrial  user  may  at  times  make  the  product  in  his  own  plant 
if  he  considers  purchase  conditions  unfavorable.  In  many  plants 
this  is  true  even  of  part  of  the  heavy  equipment.  It  is  particularly 
true  of  parts. 

12.  Most  well-organized  industrial  markets  are  "covered"  by  one  or 
more  good  trade  or  technical  journals  which,  as  advertising  media, 
afford  much  greater  proportional  coverage  than  can  be  expected  in 
any  consumer  advertising  medium. 

13.  Women  exert  little  direct  influence  upon  industrial  purchases  in  sharp 
contrast  to  their  high  degree  of  control  in  consumer  purchasing. 

Such  marked  differences  in  fundamental  factors  demonstrate 
the  impracticability  of  interpreting  data  in  either  field  on  the 
basis  of  experience  gained  exclusively  in  the  other. 

Lack  of  experience  or  previous  study  in  a  given  specialized  field 
can,  of  course,  be  offset  to  some  extent  by  the  open-mindedness 
and  objective-mindedness  of  the  investigator;  by  his  repugnance 
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to  any  sacrifice  of  thorough  analysis  to  superficial  plausibility  and 
by  his  willingness,  in  an  unfamiliar  field,  to  consult  a  number  of 
authorities  and  to  check  tentative  and  even  final  conclusions 
with  them. 

Weigh  the  Data 

It  is  obviously  necessary  to  make  an  appraisal  of  all  the 
material  on  hand  in  preparation  for  any  tentative  conclusions. 
As  previously  pointed  out,  this  is  a  more  or  less  continuing  process, 
touching  all  the  stages  of  a  research  program.  In  the  preliminary 
investigations,  appraisal  of  the  first  material  assembled  is  needed 
to  give  direction  to  further  investigation,  to  determine  what  other 
facts  and  how  many  other  facts  must  be  secured  to  carry  the 
program  through.  There  are  facts  gathered  from  existing  statisti- 
cal sources,  there  are  tabulations  made  from  questionnaires  and 
surveys  and,  in  addition  to  all  this  quantitative  material,  there  is 
usually  some  nonstatistical  information  in  the  form  of  authorita- 
tive statements  and  opinions  gathered  from  various  sources.  All 
of  these  data  must  be  separately  examined  and  pondered  upon. 

This  first  step  in  the  interpretative  phase  of  a  research  opera- 
tion may  be  likened  to  the  first  scanning  one  gives  a  hand  at 
bridge.  The  cards  are  slipped  quickly  through  the  fingers  to  see 
how  many  there  are  of  each  suit  and  what  potentialities  they  have. 
Then,  the  suits  may  be  brought  together  and  each  card  placed  in 
the  order  of  its  power — all  in  the  interval  of  appraising — apart 
from  and  in  advance  of  any  plans  for  bidding  or  playing  the  hand. 
Consonant  with  this  illustration,  the  significance,  utility  or  power 
of  each  item  of  data  must  be  examined  and  appraised. 

To  Determine  Significance.  Each  item  of  the  information 
assembled  must  be  weighed,  primarily,  to  determine  its  own  direct 
or  relative  significance  for  the  purpose  of  the  study.  This  might 
be  effected  by  subjecting  each  unit  of  data  to  some  such  question 
as:  "  Just  what  does  this  mean?"  If  the  reply  to  that  question, 
the  meaning,  is  found  directly  to  affect  the  objectives  of  the  study 
or  if  it  should  qualify,  extend  or  otherwise  alter  the  meaning  of 
any  other  item  of  data  in  such  a  manner  as  to  affect  the  objectives 
of  the  study — that  unit  of  data  is  significant  and  must  be  reserved 
for  consideration  in  the  final  interpretation  of  the  study. 

To  Determine  Value  of  Quantitative  Evidence.  A  substantial 
part  of  all  the  material  reserved  for  consideration  will  be  of  the 
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quantitative  type.  It  will  be  of  statistical  character.  The 
utility  of  data  of  this  type  depends  upon  such  points  as  reliability, 
representative  character,  pertinence  of  the  statistical  informa- 
tion; impartiality  and  disinterestedness  of  information  sources; 
and  complete  objectivity  of  the  questions  presented  in  the 
questionnaire. 

At  appropriate  junctures  throughout  the  work  each  of  these 
factors  has  become  in  turn  a  matter  of  special  concern.  All 
material  not  in  conformity  with  the  requirements  of  these  factors 
has  been  discarded  and  the  point  now  is  to  determine  whether  or 
not  the  reserved  quantitative  data  have  value  or  utility  in  the 
light  of  the  original  objectives  of  the  study. 

To  Determine  Value  of  Qualitative  Evidence.  As  previously 
stated,  the  value  of  data  of  this  type  is  dependent  upon  the 
authority  of  the  sources,  the  integrity  of  the  transmission,  and  the 
pertinence  of  those  data.  Later,  these  factors  are  to  be  scruti- 
nized explicitly,  but  at  this  juncture  the  purpose  is  rather  to  look 
through  the  reserved  qualitative  data  to  determine  with  what 
effect  the  various  units  of  such  information  can  be  used  in  further- 
ing the  purpose  of  the  study. 

Set  Up  Tentative  Conclusions 

These  early  conclusions  are  referred  to  as  " tentative,"  not 
because  they  are  in  any  sense  uncertain  but  because  they  involve 
a  problem  in  integration  which  may  at  various  points  make  adjust- 
ments necessary.  Usually,  these  tentative  conclusions  represent 
a  number  of  distinct  but  more  or  less  related  ideas,  of  quantitative 
or  qualitative  character,  which  must  be  fitted  together  into  a 
comprehensive  conclusion  that  will  represent  the  final  solution  of 
the  problem. 

By  Direct  Consideration  of  Evidence.  In  every  marketing 
study  some  of  the  data  are  found  so  directly  pertinent  that  they 
can  be  used  in  their  original  state.  In  a  study  of  sales  poten- 
tialities in  a  given  market,  for  instance,  the  total  number  of 
outlets  is  so  clearly  a  factor  as  to  be  indicative,  even  if  separated 
from  all  the  other  evidence.  This  does  not  mean  that  the  other 
evidence  can  be  disregarded,  but  only  that  all  those  data  which 
are  susceptible  to  the  interpretative  processes  as  they  stand  should 
be  examined  first. 
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The  reason  for  this  approach  is  that  it  begins  at  once  to  segre- 
gate ideas.  These  ideas  may  be  either  quantitative  or  qualitative 
and  they  all  relate  to  some  aspect  of  the  problem  but  they  will 
probably  be  found  to  have  widely  differing  degrees  of  utility.  To 
evaluate  them,  for  the  purposes  of  the  study,  they  must  be  sub- 
jected separately  to  such  inquiries  as: 

1.  To  what  aspect  of  the  problem  does  this  idea  relate? 

2.  What  conclusions  can  logically  be  drawn  from  this  idea — considered 
alone  ? 

3.  What  effect  have  those  conclusions  on  the  solution  of  the  problem? 

Such  an  inquiry  as  1  would  place  the  various  ideas  in  their  proper 
position;  inquiry  2  would  disclose  the  inherent  meaning  of  the 
respective  ideas  and  inquiry  3  would  tend  to  determine  the  value 
of  each  idea,  taken  alone,  as  a  factor  in  the  solution  of  the  problem. 

By  Correlative  Consideration  of  Data.  Except  in  the  most 
elemental  studies,  by  far  the  greater  number  of  conclusive  ideas 
results  from  the  study  of  the  various  groups  of  data  in  their  rela- 
tion to  one  another.  The  correlative  and  comparative  methods 
of  arriving  at  tentative  conclusions  are  therefore  of  sufficient 
importance  to  illustrate  carefully. 

The  United  States  Bureau  of  Foreign  and  Domestic  Commerce 
in  1935  made  a  real  property  inventory  in  sixty-four  cities. 
Inspection  of  the  statistics  of  home-repair  and  home-improve- 
ment needs,  in  these  individual  cities,  showed  at  a  glance  that  the 
greatest  needs  were  indicated  in  certain  southern  cities  with  large 
Negro  population  and  where  there  were  large  numbers  of  housing 
units  in  the  lowest  bracket  of  rent  scales. 

Closer  inspection  of  these  data,  however,  indicated  a  definite 
correlation  between  rent  scales  and  the  standards  and  physical 
condition  of  housing.  Consequently,  it  is  seen  that,  no  matter 
how  specific  the  statistical  data  on  needs  for  repairs,  bathrooms 
or  central  heating  may  have  been,  the  matter  of  capacity  to  pay 
for  them  was  a  vitally  important  marketing  consideration;  and, 
further,  that  all  these  statistical  data  must  somehow  be  related 
to  the  data  on  rent  scales  and  value  of  homes  owned — before  any 
conclusions  can  be  drawn  as  to  a  potential  market  for  repairs  and 
modernization  work. 

The  simple  statement  that  15.6  per  cent  of  the  residential 
structures  in  the  64  cities  needed  structural  repairs,  therefore, 
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required  some  correlative  analysis.  To  this  end,  the  cities  were 
listed  in  seven  classes,  in  a  descending  scale  of  median  rentals, 
with  the  following  results :  In  Class  I  cities  (with  median  family 
rentals  over  $30  per  month)  9.2  per  cent  of  the  residential  build- 
ings needed  structural  repairs;  in  Class  II  cities,  12.2  per  cent; 
in  Class  III  cities,  12  per  cent;  in  Class  IV  cities,  16.7  per  cent; 
in  Class  V  cities,  17.2  per  cent;  in  Class  VI  cities,  20.7  per 
cent ;  and  in  Class  VII  cities  (with  median  family  rentals  under 
$15  per  month)  22.8  per  cent  of  the  residential  buildings. 

Consequently,  any  estimate  of  a  potential  national  market  for 
building  rehabilitation  would  have  to  discount  the  15.6  per  cent 
figure  rather  considerably,  to  allow  for  the  inability  of  large 
numbers  of  owners  and  properties  to  stand  the  cost.  For  inter- 
pretative purposes,  therefore,  the  correlative  analysis  sub- 
stantially affected  the  significance  of  these  data. 

As  a  further  example,  also  taken  from  the  building  field:  The 
figure  customarily  used  in  estimating  the  replacement  market  for 
residential  buildings  is  2  per  cent  of  existing  structures.  This  is 
based  on  the  theoretical  assumption  that,  since  buildings  will 
probably  not  last  more  than  fifty  years,  they  ought  to  be  replaced 
at  the  rate  of  2  per  cent  a  year.  Actual  replacements,  however, 
have  never  approached  that  figure,  and  one  authority,  who  has 
recently  given  some  time  to  a  factual  study  of  the  matter,  has 
affirmed  that  the  replacement  rate  in  recent  decades  has  been 
about  seven-tenths  of  one  per  cent  a  year. 

The  frequently  quoted  and  generally  accepted  2  per  cent 
figure,  therefore,  represents  accounting  theory  plus  wishful  think- 
ing— not  facts.  The  difference  between  theory  and  fact  in  this 
case  represents  nearly  400,000  new  dwelling  units  per  year  needed 
for  replacement  in  the  building  field. 

In  considering  such  data,  therefore,  as  a  basis  for  sound  con- 
clusions, it  is  necessary  to  correlate  the  statistics  with  every  other 
known  factor  which  might  in  any  measure  qualify  or  affect  the 
correctness  of  the  conclusion.  In  this  matter  of  estimating  the 
replacement  market  for  residential  buildings,  for  instance,  such 
factors  as  the  following  must  be  taken  into  account : 

1.  The  general  tendency  of  most  American  property  owners  to  neglect 
necessary  repairs. 
•  2.  Reduced  incomes,  deflated  property  values,  fear  of  spending  and  getting 
into  debt — which  were  potent  factors  in  the  depression  years. 
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3.  The  fact  that  many  buildings,  needing  repairs  and  improvements,  do 
not  justify  large  expenditures  of  money  on  the  basis  of  current  income 
or  use. 

4.  The  fact  that  housing  standards  and  living  standards  vary  quite  con- 
siderably, thus  making  sweeping  generalizations  somewhat  hazardous. 

5.  The  fact  that  expenditures  for  new  housing  and  housing  improvements 
depend  a  great  deal  more  upon  the  capacity  of  the  owner  to  spend  than 
upon  the  needs  of  the  owner  or  of  the  property. 

It  will  be  seen  at  a  glance  that  not  all  of  these  several  factors 
are  susceptible  of  statistical  measurements.  Those  that  are 
would  probably  require  collateral  research;  but,  with  the  factual 
data  obtained,  correlations  will  establish  what  effect  they  may 
have  on  the  conclusions  to  be  drawn  from  the  primary  data. 
Those  factors  which  are  not  measurable  statistically  would  prob- 
ably fall  within  the  definition  of  qualitative  data  and  should  be 
so  considered. 

By  Study  of  Interrelationship  of  Quantitative  and  Qualitative 
Data.  Having  drawn  all  the  tentative  conclusions  possible  from 
the  direct  consideration  of  the  quantitative  and  qualitative  data 
and  from  their  respective  correlations,  there  remains  to  examine 
in  what  manner,  if  at  all,  the  two  types  of  data  influence  each  other 
with  respect  to  the  objectives  of  the  study.  The  situation  just 
referred  to,  estimating  the  replacement  market  for  residential 
buildings,  in  which  some  of  the  factors  are  qualitative  in  charac- 
ter, is  a  case  in  point. 

As  another  simple  example:  Suppose  the  problem  were  to 
ascertain  the  marketing  potentialities  of  some  new  product.  The 
quantitative  aspects  of  the  field  are  readily  ascertainable — the 
population,  the  distribution  of  wealth  or  income,  the  number  and 
accessibility  of  the  outlets,  the  efficacy  of  the  various  advertising 
media  in  the  area,  the  number  of  salesmen  available  for  the  work, 
some  measurable  reflections  on  existing  and  prospective  competi- 
tion; but  what  about  the  reactions  of  the  people? 

Such  material  as  would  disclose  the  probable  attitude  of  the 
public  would  be  largely  qualitative  in  character  and,  necessarily, 
no  solution  of  the  problem  could  have  any  value  that  did  not 
consider  every  facet  of  consumer  reaction  in  its  relation  to  the 
more  concrete  quantitative  data.  In  practice,  therefore,  the  two 
types  of  evidence  must  be  read  side  by  side.  Each  item  must  be 
carefully  scrutinized  for  any  bearing  or  influence  it  might  logically 
have  on  any  conclusion  suggested  by  any  item  of  the  opposite  type. 
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For  example,  every  once  in  a  while  a  rumor  spreads  around  that 
a  certain  South  American  tea  is  about  to  be  put  on  the  United 
States  market  in  an  important  way.  Quite  clearly  this  country 
presents  all  the  quantitative  factors  of  a  market  for  such  a 
product.  There  are  potential  consumers  here  in  great  numbers; 
they  have  the  capacity  to  buy  such  a  product  in  volume;  there 
are  some  hundreds  of  thousands  of  outlets,  readily  accessible; 
everything  is  here  in  fact  and  measurable  as  an  opportunity. 

It  would  be  a  gamble,  however,  to  undertake  the  introduction 
of  such  a  product  in  this  country  without  first  determining  the 
attitude  of  the  prospective  consumer.  And  this  would  have  to 
be  ascertained  with  respect  to  a  number  of  factors.  First  would 
come  the  very  subtle  factor  of  taste — would  the  people  here  like 
the  flavor  of  the  new  tea?  Then  would  come  the  question  of 
appearance — would  they  "like  the  looks"  of  the  product — raw 
and  prepared?  Next  would  come  the  matter  of  convenience — 
would  the  new  product  be  as  easily  handled,  stored  and  brewed 
as  are  the  present  teas  and  coffees?  And,  of  course,  the  question 
of  economy  would  arise — as  to  how  its  cost  per  cup  or  per  glass 
would  compare  with  the  beverages  now  being  used. 

Given  these  two  groups  of  data  in  such  a  problem,  the  study 
of  the  interrelationships  between  them  would  involve  an  appraisal 
of  the  sum  total  of  all  the  qualitative  data  with  respect  to  each  of 
the  several  items  of  quantitative  data.  What  is  the  total  reaction 
as  to  taste,  as  to  appearance,  as  to  convenience,  etc.?  To  what 
extent  is  it  favorable  or  unfavorable?  Are  the  obstacles  sur- 
mountable? And  so  on,  until  the  influence  of 'the  one  type  of 
data  on  the  other  has  been  thoroughly  examined  and  evaluated. 

There  are  no  laws  and  no  recognized  rules  to  govern  this  phase 
of  interpretative  work.  Probably  more  than  any  other  phase  of 
marketing  research,  the  interpretation  of  the  relationship  between 
quantitative  and  qualitative  data  rests  upon  the  judgment  of  the 
interpreter.  It  requires  a  sound  deductive  sense  based  upon  a 
broad  experience  in  marketing  with  special  reference  to  the 
subject  matter  of  the  study. 

Test  Tentative  Conclusions 

In  research  work  of  any  kind,  the  idea  of  testing  is  always  and 
everywhere  present.  In  marketing  research,  the  phrasing  of  the 
questionnaire  and  its  effectiveness  in  the  field  are  tested;  tests  are 
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applied  at  various  points  during  the  collection  of  data  and  its 
organization;  and  even  data  drawn  from  sources  of  established 
authority  are  subjected  to  critical  scrutiny.  So  then,  as  a  final 
precaution  against  error,  conclusions  also  must  be  tested  in  as 
many  ways  as  possible. 

By  Double  Check  of  Evidence.  This  is  to  "make  assurance 
doubly  sure"  and  it  may  be  accomplished  by  bringing  each  con- 
clusion within  the  focus  of  concentrated  attention  by  applying 
to  it  some  such  inquiries  as  these : 

1.  Can  it  be  said  with  certainty  that  all  the  evidence  is  in  and  that  no 
factors  have  been  overlooked? 

2.  Are  there  sufficient  data  to  support  the  conclusions? 

3.  Are  there  any  elements  in  any  of  the  conclusions  which  are  not  in  har- 
mony with  everything  else  in  the  study  ?     Are  there  any  inconsistencies  ? 

4.  Are  the  conclusions  free  of  bias  and  free  from  the  influence  of  any  pre- 
conceived prejudices? 

5.  Are  the  conclusions  in  balance — that  is,  are  the  major  factors  given 
adequate  emphasis  and  is  there  no  undue  significance  attached  to  any 
minor  point? 

6.  Any  other  question  which  the  situation  suggests  and  which  might 
tend  to  expose  any  omission,  inconsistency  or  error  in  the  conclusions. 

By  Examination  in  the  Light  of  Common  Sense.  The  most 
serviceable  of  all  instruments  in  the  interpretation  of  data  is  that 
elusive  faculty,  common  sense.  It  is  a  sort  of  crucible  for  the 
refinement  of  facts,  as  well  as  of  the  interpreter's  imagination, 
and  in  a  marketing  study  everything  must  be  run  through  it. 

In  a  competently  conducted  research  project,  common  sense 
has,  of  course,  been,  playing  around  and  about  every  movement 
since  its  inception.  The  test  now  is  limited  to  the  conclusions,  as 
to  whether  they  are  in  accord  with  the  most  logical  and  believable 
construction  of  the  whole  assembly  of  data. 

To  illustrate :  A  survey  of  a  thousand  Michigan  households  was 
made  early  in  1934  in  which  it  was  found  that  43.2  per  cent  of  the 
householders  contemplated  major  purchases  in  the  succeeding 
six  months  and  that  46.7  per  cent  of  this  group  which  planned 
new  purchases  planned  to  buy  new  cars.  So  far  as  automobiles 
were  concerned,  the  survey  as  published  did  not  go  beyond  stating 
these  results.     That  is  as  far  as  this  study  was  intended  to  go. 

Suppose,  however,  that  an  interpreter  were  to  conclude  from 
these  figures  that  20  per  cent,  which  is  46.7  per  cent  of  43.2  per 
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cent,  of  all  Michigan  householders,  were  definitely  going  to  buy- 
cars  in  the  succeeding  six  months.  This  would  mean  average 
monthly  sales,  for  the  period,  of  nearly  38,000  cars— a  prospect 
to  gladden  the  heart  of  anyone  with  new  cars  to  sell. 

Reference  to  the  records  of  new  car  registrations  in  Michigan, 
however,  for  the  past  six  years,  shows  any  such  expectation  to  be 
absurd.  Only  in  one  single  month  in  that  whole  six-year  period 
— which  includes  1929 — have  the  registrations  of  new  cars  in 
Michigan  reached  38,000;  and  the  average  monthly  registration 
for  the  heaviest  six-month  period  during  1934,  March  to  August 
inclusive,  is  just  a  shade  over  13,000  cars.  Examined  in  the  light 
of  common  sense,  therefore,  a  sales  forecast  of  38,000  cars  per 
month  would  be  manifestly  and  grossly  misleading. 

Another  example :  A  published  survey  on  brand  preferences  for 
coffee  covered  2,648  cases.  These  cases  were  classified  by  twenty- 
one  different  brands  and  three  income  brackets  of  consumers — a 
total  of  sixty-three  group  items.  Average  coffee  consumption 
per  month  was  figured  in  this  study  even  where  there  was  only  one 
item  in  the  group.  No  detailed  study  of  the  theory  of  probability 
is  required  to  appreciate  that  a  single  observation  may  give  almost 
any  conceivable  answer.  Common  sense  alone  would  condemn 
such  a  procedure. 

Preference  questionnaires  furnish  frequent  examples  of  sweep- 
ing conclusions  at  variance  with  common  sense.  For  instance, 
much  is  sometimes  made  of  a  very  small  percentage  lead,  which 
might  be  due  to  pure  chance.  If  a  coin  is  tossed  a  million  times, 
it  will  most  likely  show  heads  500,000  times  and  tails  500,000 
times;  but  if  it  is  tossed  only  a  hundred  times,  there  is  an  excellent 
chance  of  getting  fifty-five  heads  and  forty-five  tails.  Yet  a 
single-preference  questionnaire  with  fifty-five  "  Yes"  answers  and 
forty-five  "No"  answers  can  be  made  highly  significant,  and 
probably  misleading,  if  expressed  as  a  22  per  cent  lead.  Judg- 
ment— common  sense — should  suggest  caution  in  the  use  of 
percentages  based  on  small  numbers  of  items. 

Still  another  example  of  the  criterion  of  common  sense:  In  a 
study  of  the  advertising  influence  of  two  newspapers,  it  was 
found  that  Newspaper  A  predominated  in  the  highest-income 
group  while  Newspaper  B  predominated  in  all  the  other  income 
levels — except  the  lowest,  where  Newspaper  A  again  took  the 
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lead.  Considered  solely  as  a  statistical  statement,  it  would 
appear  that  the  paper  which  was  read  by  the  elite  of  the  city  was 
read  also  by  its  typical  southern  Negro  population.  Such  a 
conclusion  is  opposed  to  common  sense.  No  paper  written  for 
intellectuals  could  possibly  interest  a  population  preponderantly 
illiterate.  Further  investigation  proved  that  the  Negro  popula- 
tion of  that  city,  a  considerable  percentage  of  the  whole,  bought 
the  elite  paper  simply  because  it  carried  the  New  York  daily 
bank  clearings  which  served  as  a  code  for  a  popular  policy  racket. 
Such  a  circumstance  naturally  changed  the  significance  of  the 
purely  statistical  phase  of  the  study. 

By  Comparison  with  Alternative  Possibilities.  This  might 
be  called  a  negative  test.  It  consists  in  an  assumption  that  the 
interpretation  placed  upon  any  part  or  upon  all  the  data  is  wrong 
and  in  a  sincere  attempt  to  prove  another  construction  to  be 
correct.  It  is  a  challenge  to  the  mind — forcing  it  to  concentrate 
on  and  to  explore  any  other  conclusions  that  might  in  any 
measure  seem  plausible. 

In  practice,  most  of  the  alternative  possibilities  are  at  this  point 
pretty  well  eliminated.  This  test  is  intended  finally  to  weed  out 
any  alternatives  that  might  remain  and  to  give  assurance  that 
under  the  circumstances  and  in  the  light  of  the  data  examined, 
no  other  conclusions  are  tenable. 

Formulate  Final  Conclusions 

This  is,  of  course,  the  focal  point  of  every  marketing  study. 
Since  the  inception  of  the  work,  every  step  has  been  in  the  direc- 
tion of  an  accurate,  comprehensive  and  demonstrably  sound  body 
of  conclusions.  As  a  matter  of  fact,  the  final  conclusions  can  be 
little  more  than  the  tentative  conclusions,  smoothed  out  and 
adequately  tested. 

There  are,  however,  several  points  to  determine  in  connection 
with  final  conclusions. 

To  Accord  with  the  Specifications.  In  Analyzing  the  Problem, 
Chap.  I,  certain  convictions  were  arrived  at  as  to  what  facts 
would  be  needed  to  solve  the  problem,  where  these  facts  might  be 
found  and  how  they  should  be  sought.  How  closely  this  plan 
has  been  followed  can  be  determined  by  examining  the  work  on 
the  following  points : 
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Certain  facts  were  specified  as  neces-  Have  these  conclusions  been  based 
sary  to  the  purposes  of  the  study.  upon  precisely  those  facts?     And 

have    all    those    facts    been    con- 
sidered? 

Certain  specifications  were  made  as  Have  the  facts  upon  which  these 
to  where  the  necessary  facts  were  conclusions  are  based  been  drawn 
to  be  found.  f  rom  precisely  those  sources  ?     And 

have  all  those  sources  been  con- 
sulted? 

Certain  methods  were  specified  for  Were  these  conclusions  arrived  at  by 
the  conduct  of  the  study.  precisely     those     methods?     And 

would    any    other   methods   have 
accomplished  different  results? 

This  does  not  mean  that  conclusions  not  conforming  with  these 
specifications  are  of  lesser  consequence  or  reliability.  It  means 
only  that,  whatever  else  may  have  been  done,  no  conclusions 
should  be  regarded  as  final  until  all  the  specifications  originally 
set  up  have  been  met.  Further,  that  any  deviations  from  those 
original  specifications  should  be  fully  explored— as  to  whether 
justified  and  material  and  as  to  their  possible  effect  on  the  con- 
clusions as  finally  adopted. 

To  Reflect  Fully  the  Conditions  Disclosed.  At  this  closing 
juncture  of  a  study,  when  every  step  has  been  carefully  executed 
and  all  the  tentative  conclusions  tested,  there  should  be  little 
room  for  doubt  as  to  the  underlying  pertinence  and  correctness 
of  the  final  results. 

The  point  here  is  to  make  sure  that  in  this  interpretative  stage 
every  ascertained  feature  of  the  situation  shall  have  been  duly 
and  adequately  considered;  that  appropriate  weight  shall  have 
been  given  to  every  circumstance  that  could  in  any  measure 
affect  the  soundness  of  the  work  and  that  the  conclusions  which 
finally  emerge  shall  rest  upon  the  full  body  of  data. 

Certainly,  in  formulating  final  conclusions,  no  unfavorable  fact 
or  implication  which  is  material  to  the  issue  should  be  consciously 
subordinated  or  omitted.  To  do  so  deliberately,  for  the  purpose 
of  obscuring  or  perverting  truth  would,  of  course,  be  highly 
unethical  and  reprehensible. 

As  an  ultimate  precaution,  therefore,  the  interpreter  might 
well  address  to  himself  one  comprehensive  question — as  to 
whether  or  not  the  conclusions  as  a  whole  represent  a  full,  true, 
logical  and  inescapable  interpretation  of  the  completed  study. 
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To  Attain  the  Objectives  Originally  Defined.  At  the  beginning 
of  the  study  certain  objectives  were  determined  upon.  Some- 
thing had  to  be  proved  or  disproved,  some  situation  had  to  be 
clarified  or  some  problem  or  circumstance  illuminated.  The 
point  now  is  to  make  sure  that  the  final  conclusions  represent  the 
fullest  possible  attainment  of  those  original  objectives.  If  so, 
the  study  phase  can  be  regarded  as  complete  and  the  equally 
important  phase  of  Presentation  ready  for  consideration. 
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CHAPTER  XVII 
PRESENTATION  OF  RESULTS 

(As  Presented  in  Chart  I) 

In  most  marketing  studies  this  is  the  point  of  culmination.  All 
that  has  gone  before  has  been  leading  up  to  this  phase.  It  is  at 
this  stage  that  the  data  and  all  the  conclusions  derivable  there- 
from are  to  be  embodied  into  a  report.  The  purpose  of  the  report 
is  to  convey  to  interested  persons  the  whole  result  of  the  study,  in 
sufficient  detail  and  so  arranged  as  to  enable  each  reader  to 
comprehend  the  data  and  to  determine  for  himself  the  validity 
of  the  conclusions. 

Generally  speaking,  the  technique  of  report  preparation  divides 
itself  into  two  important  aspects :  editorial  procedure  and  techni- 
cal details.  A  well-finished  product  calls  for  the  nearest  possible 
approach  to  perfection  in  both.  The  production  of  a  research 
report  may  be  likened  to  the  production  of  an  industrial  product. 
The  facts  and  figures  of  the  survey  correspond  to  the  raw  material 
in  the  industrial  process  while  the  author — who  edits,  correlates 
and  interprets  the  facts  into  a  finished  presentation — performs 
the  function  of  the  machine  which  shapes  and  molds  the  physical 
raw  material  into  a  completed  product.  Further,  just  as  skillful 
use  of  tools  and  machines  is  needed  to  insure  perfect  production 
of  commercial  products,  so  in  any  kind  of  survey  work  the 
intelligent  arrangement  of  data  is  of  primary  importance  in  the 
presentation  of  results.  The  many  details  of  such  a  presentation 
must  be  given  both  individual  and  collective  consideration  if  a 
comprehensive,  convincing  and  constructive  report  is  to  ensue. 

Confer  with  Interested  Associates 

This  is  an  editorial  precaution.  Its  purpose  is  to  make  sure 
that  the  material  reserved  for  presentation  embraces  all  the 
significant  points;  to  determine  such  details  as  the  sequence  in 
which  the  points  are  to  be  presented,  the  degree  of  emphasis  each 
is  to  have,  the  extent  of  elaboration  required  for  each,  what  data 
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should  be  set  up  graphically  and,  generally,  to  utilize  the  collec- 
tive judgment  of  as  large  a  number  of  interested  and  capable 
persons  as  possible  regarding  the  suitability  of  the  presentation  in 

all  respects. 

Aside  from  these  broad  purposes,  there  are  certain  specific 
considerations  to  which  the  judgment  of  the  group  should  be 

directed. 

To    Conform    with    Expediency    and    Diplomacy.     It    is   an 

inviolable  rule  that  no  facts  disclosed  by  any  study  may  be  sup- 
pressed or  distorted  or  softened  for  any  reason  whatsoever. 
Research  has  no  purpose  except  to  reveal  and  certify  the  truth. 
With  respect  to  a  specific  inquiry,  however,  not  all  the  truth  is 
important;  some  of  it  may  not  even  be  germane.  The  presenta- 
tion has  a  function  to  perform:  It  is  to  disclose  and,  perhaps, 
explain  some  fact  or  circumstance,  to  prompt  some  action  along 
the  lines  indicated  by  the  facts  revealed,  to  effect  a  change  in 
attitude  or  practice.  If  the  study  is  to  be  constructive,  the 
presentation  must  induce  a  practical  executive  decision.  So  far 
as  possible,  therefore,  the  report  must  present  all  the  truth  that  is 
essential  in  such  a  manner  as  not  to  obstruct  the  action  indicated 
or  prescribed  by  the  study. 

As  a  simple  example  of  expediency,  as  a  criterion  in  the  selection 
of  material  for  report  purposes,  such  a  situation  as  this  may  be 
considered :  In  a  study  to  determine  the  causes  of  a  marked  and 
progressive  falling  away  of  volume  of  sales  and  profits  in  a  certain 
business,  the  field  study  developed  as  one  of  the  factors  a  con- 
siderable body  of  adverse  comment  on  the  quality  of  the  product 
— and,  of  course,  some  few  favorable  comments. 

In  the  report,  all  favorable  comments  were  properly  omitted. 
Since  the  whole  purpose  of  the  work  was  to  improve  the  firm's 
position  by  throwing  a  spotlight  on  its  weaknesses,  it  was 
regarded  as  inexpedient  to  give  the  management  the  slightest 
excuse  for  inaction  by  rose-tinting  the  beam  with  even  the  few 
flecks  of  favorable  evidence.  These  could  have  had  no  effect 
whatever  upon  the  validity  of  the  conclusions  but  they  might 
very  well  have  distracted  some  of  the  less  objectively  minded 
executives  from  the  main  purpose  of  the  study. 

The  requirement  of  diplomacy  may  be  even  more  subtle. 
Every  marketing  man  has  at  some  time  or  other  seen  the  fruit  of 
his  labor  filed  away  in  a  pigeonhole  to  molder  in  futility.     This 
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cannot  always  be  avoided.  The  result  of  a  study  as  embodied  in 
a  report  belongs  to  the  sponsor  who  paid  for  it.  He  can  do  with  it 
what  he  chooses — and  all  too  often  he  does  what  his  mood 
dictates. 

In  a  great  many  specific  studies,  as  for  instance  in  copy  testing, 
measuring  sales  potentialities,  determining  the  suitability  of  a 
product  for  a  given  market — where  the  field  lies  outside  of  a 
business — the  matter  of  diplomacy  in  a  presentation  is  of  no 
great  consequence.  But  the  moment  the  inquiry  is  turned 
inward  on  the  business,  as  is  so  frequently  the  case  in  exploratory 
studies,  the  report  with  all  it  represents  is  exposed  to  complex 
personal  reactions  on  the  part  of  those  involved.  In  such  cases, 
diplomacy  is  of  high  consequence.  It  is  not  sufficient  that  the 
report  contain  the  truth ;  if  there  is  to  be  any  result  in  action,  the 
truth  must  be  so  presented  as  not  to  arouse  undue  resentment. 

A  certain  newspaper  regarded  itself  as  the  leader  in  its  market. 
To  prove  its  dominance  to  space  buyers,  the*  management  had  a 
survey  made.  It  was  a  great  disappointment.  It  showed  that  in 
some  very  important  aspects  that  paper  was  far  from  holding  the 
leadership.  Of  course  the  study  could  not  be  used  for  the  purpose 
for  which  it  had  been  intended.  The  report,  however,  so  isolated 
the  paper's  several  weaknesses  that  a  little  special  attention  to 
each  could  readily  have  corrected  them  all.  The  younger  men 
on  the  paper's  staff  recognized  this  and  urged  action.  But, 
unfortunately  for  the  property,  the  editor,  the  business  manager 
and  the  circulation  manager,  all  mellowed  by  advancing  years, 
repudiated  the  study.  To  them  it  was  all  wrong.  It  contra- 
dicted some  of  their  pet  ideas;  it  offended  their  vanity  and  exposed 
them  to  censure.  They  resented  it;  they  refused  to  act  on  it; 
figuratively,  they  threw  the  study — and  the  several  thousands  of 
dollars  it  cost — into  the  waste  basket.  Significantly  enough, 
however,  within  a  year  that  paper  was  amalgamated  with  its 
principal  competitor. 

In  another  instance,  the  management  of  a  manufacturing 
company  complacently  concurred  in  the  sabotage  of  a  promotional 
idea  that  had  cost  the  company  probably  half  a  million  dollars. 
Its  efficacy  had  been  proven  beyond  any  reasonable  doubt. 
Management  might  have  developed  it  and  made  it  highly  profit- 
able for  many  years  to  come;  but  some  collateral  studies  had 
resulted  in  official  resentment  against  the  idea  and  pride  demanded 
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that  the  plan  be  destroyed.  The  obstruction  was  covert  but  its 
motive  was  as  simple  as  that. 

It  is  not  argued  here  that  in  these  particular  instances  any 
different  results  might  have  been  achieved  through  more  tactful 
presentation,  nor  that  more  tactful  presentation  was  even  possi- 
ble. These  examples  are  intended  rather  to  demonstrate  the 
need  for  the  maximum  consideration  of  the  interests  and 
sensibilities  of  the  persons  affected — within  the  boundaries  of 
the  truth. 

In  one  study,  for  instance,  it  was  apparent  at  once  that  the 
unfavorable  marketing  position  of  the  company  was  due  solely 
to  the  ineptitudes  of  its  president.  The  research  agency  conduct- 
ing the  study  realized  the  possible  futility  of  continuing  the  work, 
because  of  that  officer's  almost  inevitable  resentment.  As  soon, 
therefore,  as  sufficient  data  had  been  assembled  clearly  to  fix  the 
responsibility,  a  preliminary  report  was  submitted  to  the  president 
which  placed  the  bla"me  squarely  on  his  own  shoulders. 

This  report  was  intended  as  a  " feeler"  to  test  the  president's 
fortitude.  It  covered  only  one  of  the  four  phases  of  the  business 
originally  designated  for  study;  but,  obviously,  there  would  have 
been  no  point  in  pursuing  it  further  if  the  effect  of  the  first  dis- 
closures were  to  discourage  action.  For  that  reason  the  research 
agency  itself  proposed  that  it  proceed  no  further  with  the  study 
unless  the  preliminary  report  were  accepted  as  entirely  satisfac- 
tory. Fortunately  for  the  property,  the  president  of  the  company 
insisted  on  the  completion  of  the  work.  The  study  was  then 
resumed.  The  full  report  was  presented,  its  several  corrective 
recommendations  were  gradually  put  into  effect,  the  business  was 
revived  and  is  again  prospering. 

To  Utilize  the  Experience  of  Other  Advisors.  Where  a  market- 
ing study  has  been  made  through  a  medium  apart  from  the  client's 
advertising  agency,  it  would  seem  desirable,  before  completing  a 
final  report,  to  discuss  the  findings  with  the  agency — first,  to  give 
it  and  its  executives  an  opportunity  to  explore  the  uses  to  which 
the  survey  might  be  put  and,  second,  to  give  the  research  group 
the  benefit  of  the  advertising  agency's  general  body  of  experience. 

If  cost  of  distribution  should  be  a  factor  in  the  situation  dis- 
closed by  the  study,  it  might  be  desirable  to  discuss  with  the 
company's  auditors  all  that  part  of  the  report  which  is  designed 
to  deal  with  the  subject  of  cost. 
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The  point  is  to  take  into  consideration  and  council  all  those 
persons  whose  relationship  to  the  business  qualifies  them  to  speak 
with  authority  on  specific  phases  of  the  study  and  whose  contribu- 
tions might  enhance  the  accuracy,  completeness,  credibility  and 
general  effectiveness  of  the  report. 

It  is  a  matter  of  judgment,  however,  to  determine  how  much, 
if  any,  of  the  report  or  its  conclusions  should  prematurely  reach 
the  individuals  directly  concerned  with  the  work.  That  is  to  say, 
while  the  advertising  agency,  the  cost  accountant,  the  traffic 
manager,  the  credit  manager  and,  perhaps,  even  the  sales  manager 
might  safely  be  consulted  on  points  within  their  respective  fields, 
a  consultation  with  the  chief  administrative  officers  might  under 
some  circumstances,  and  by  inadvertent  suggestion  or  implica- 
tion, predetermine  their  attitude  toward  the  work  to  the  dis- 
advantage of  the  company's  interests. 

To  Secure  Important  Last -minute  Reactions.  This  is  just  a 
natural  and  logical  precaution  against  oversight.  It  is  likely  that 
when  a  study  has  reached  this  stage,  a  conference  of  all  those  who 
have  participated  in  its  development  would  serve  as  an  effective 
safeguard  against  omissions,  as  well  as  a  warranty  of  the  inclusion 
of  all  essential  matter. 

Determine  Form  and  Manner  of  Presentation 

A  research  presentation  may  be  given  the  form  of  a  report  to 
be  read  by  or  to  the  client;  or  it  may  be  delivered  or  read  to  a 
group — as  an  address;  or  it  may  be  set  up  in  some  special  manner 
— as  with  the  use  of  large  graphic  and  pictorial  displays.  Which 
of  these  several  methods  is  to  be  employed  is  sometimes  a  crucial 
decision  and  the  selection  is  governed  by  the  circumstances 
which  in  each  case  surround  the  study  itself,  the  person  presenting 
the  report  and  the  client. 

For  Personal  Presentation.  Examining  this  method  in  the 
light  of  the  three  factors  just  enumerated,  the  first  point  to  deter- 
mine is  whether  or  not  the  study  lends  itself  to  individual  reading. 
On  this  point  the  following  are  some  of  the  considerations  which 
should  be  taken  into  account : 

1.  Does  the  study  involve  a  multiplicity  of  long  complex  tabulations 
which  must  be  presented  in  just  that  form? 

2.  Does  the  study  rest  upon  close  reasoning,  so  that  it  must  be  read  care- 
fully and  thoughtfully  for  a  clear  and  complete  understanding? 
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3.  Is  any  phase  of  the  study  confidential  to  the  chief  executive? 

4.  Are  the  data  of  such  character  as  may  require  frequent  reference  to 
tables,  charts  or  graphs? 

5.  Does  the  study  embrace  a  number  of  ramifications  which  cannot  well 
be  followed  otherwise  than  by  reading? 

6.  Does  the  study  tend  to  reflect  adversely  on  any  department  or  executive 
in  the  business? 

If  the  study  has  these  characteristics  it  would  seem  advisable 
to  present  the  report  to  the  client  for  his  own  private  reading. 
But  there  are  two  other  factors  which  might  also  affect  the 
method  of  presentation — the  first  being  the  person  presenting  the 
report. 

1.  Is  he  the  type  of  person  who  might  read  a  report  aloud  with  force  and 
effect? 

2.  Is  he  equipped  by  disposition,  training  and  special  knowledge  of  the 
study  to  elucidate  clearly  and  convincingly  any  obscure  points? 

3.  Can  he  be  depended  upon  to  defend  any  controversial  position  pre- 
sented in  the  report? 

4.  Has  he  the  ability  to  sell  the  ideas  or  the  recommendations  advanced 
in  the  report? 

Considerations  of  this  sort  determine  whether  or  not  the 
person  reporting  might  safely  undertake  to  read  the  report  aloud 
to  the  client.  And  reading  aloud  has  some  advantages:  Appro- 
priate degrees  of  emphasis  can  be  put  upon  salient  points;  parts, 
of  lesser  importance,  may  be  subordinated ;  impromptu  interpreta- 
tions and  elaborations  may  be  interjected  as  occasions  arise; 
questions  can  be  answered  on  the  spot  and  danger  of  misunder- 
standing some  of  the  points  easily  obviated.  If  the  person 
presenting  the  report  lacks  the  indicated  and  essential  character- 
istics, however,  a  written  copy  of  the  report  should  be  turned 
over  to  the  client  for  private  reading. 

Finally,  the  question  as  to  whether  the  report  should  be  read 
aloud  to  the  client  or  left  with  him  for  private  reading  should  be 
considered  with  respect  to  such  points  as  these: 

1.  Is  the  client,  himself,  a  studious  sort  of  person — accustomed  to  thought- 
ful reading? 

2.  Is  he  deliberative  by  disposition — and  therefore  likely  to  require  time 
to  reason  his  way  through  the  presentation? 

3.  Is  he  a  vacillating  person — requiring  the  steadying  influence  of  the 
written  word  before  him? 
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4.  Is  he  ultra-conservative  or  overly  cautious — requiring,  therefore,  con- 
siderable weighing  of  pros  and  cons,  frequent  reference  to  data  and 
many  rereadings  of  comments  and  arguments? 

If  the  client  has  any  of  these  characteristics,  the  report  had  better 
be  left  with  him  to  read  in  his  own  good  time  and  manner.  But  if 
he  should.be  of  the  opposite  type — quick,  nervous,  impulsive, 
impatient — or  if  he  should  lack  the  faculty  of  concentration,  or 
if  he  should  be  lazy  or  temperamentally  complacent,  it  would 
probably  prove  more  effective  to  read  the  report  to  the  client 
aloud. 

In  any  case,  of  course,  a  written  copy  of  the  report  is  always  to 
be  left  with  the  client.  The  point  to  be  stressed  here  is  that 
certain  types  of  executives  cannot  be  depended  upon  to  read  a 
report  thoroughly  or  thoughtfully.  They  must  have  it  read  or 
"talked"  to  them.  They  profess  an  aversion  to  detail,  and 
everything  is  " detail"  which  requires  any  sustained  attention. 
Usually,  this  is  an  affectation.  Only  in  rare  instances  is  any 
executive  so  gifted  as  to  require  no  detailed  study  of  his  business. 
In  some  cases  the  dislike  of  detail  is  sheer  intellectual  sloth.  But 
whatever  it  is,  genuine  or  spurious,  the  research  man  must  take 
his  client's  own  character  into  consideration  in  presenting  a  report. 

For  Group  Presentation.  There  are  circumstances  in  which 
the  presentation  of  a  research  report  must  be  made  to  several 
persons.  In  some  cases,  the  several  persons  may  be  taken  in 
succession  but,  usually,  these  presentations  are  made  to  the 
group.  The  criterion  as  to  whether  this  form  is  to  be  used  rests 
upon  the  same  three  factors — the  first  being  the  study  itself : 

1.  Does  the  study  involve  several  divisions  of  the  business?  That  is  to 
say,  do  its  findings  or  recommendations  touch  the  financial,  production 
and  service  departments  as  well  as  that  of  sales;  are  a  number  of 
executives  affected? 

2.  Is  the  subject  matter  such  as  should  be  presented  to  a  board  of  directors 
or  perhaps  to  an  executive  or  other  committee? 

3.  Is  the  study  free  of  critical  comment  which  might  embarrass,  offend  or 
adversely  affect  any  part  of  the  audience? 

4.  Is  the  study  such  as  would  need  or  inspire  elaboration,  discussion  or 
debate  during  presentation? 

5.  Is  there  any  reason  to  believe  that  a  group  presentation  is  more  likely 
to  result  in  action? 

If  the  study  has  these  characteristics,  it  is  clearly  suitable  for 
group  presentation.     But  if  it  contains  any  highly  controversial  or 
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inflammable  elements,  it  is  well  to  precede  the  group  presentation 
with  some  careful  stage  management. 

The  person  who  is  to  make  a  group  presentation  should  be 
considered  carefully  as  to  such  points  as  these: 

1.  Is  he  accustomed  to  group  selling? 

2  Has  he  the  necessary  personal  qualifications — presence,  poise,  fluency, 
force,  persuasiveness,  etc.? 

3.  Will  he  be  able  to  hold  his  own  against  any  possible  "heckling"  from 
the  audience? 

4.  Is  he  fully  conversant  with  every  step  in  the  procedure  and  with  all  the 
methodology  employed? 

Quite  clearly,  unless  the  person  has"  these  characteristics,  the 
presentation  had  better  be  submitted  to  the  various  parties  as  a 
written  report  for  their  private  or  oral  reading. 

Finally,  the  client's  own  characteristics  are  to  be  considered  as 
to  the  following  points : 

1.  Is  the  client  himself  inclined  toward  group  presentation?  Does  he 
want  his  staff  to  hear  the  report? 

2.  Is  the  client  or  his  staff  inclined  characteristically  to  ask  questions;  do 
they  arrive  at  an  understanding  more  quickly  or  more  certainly  in 
that  way? 

3.  Has  the  client  allowed  any  factional  or  political  cliques  to  develop 
within  the  organization — which  might  make  the  presentation  an  occa- 
sion for  conflict  to  the  detriment  of  the  study? 

For  Enlarged  Graphic  Displays.  The  suitability  of  this  type 
of  presentation  is  also  determined  by  the  characteristics  of  the 
study,  the  person  making  the  presentation  and  the  client  himself. 
Generally  speaking,  this  is  a  form  of  "group"  presentation  and 
is  affected  by  all  the  considerations  set  forth  under  that  heading. 

Where  the  study  contains  statistical  material,  susceptible  to 
presentation  in  graphs,  charts,  diagrams  and  other  pictorial 
devices,  the  original  small-scale  drawings  may  be  enlarged  to  such 
size  as  may  be  readily  legible  from  any  point  in  the  presentation 
room.  The  enlargement  may  be  done  by  redrawing  on  the  scale 
desired  or,  if  the  necessary  equipment  is  available,  the  original 
drawings  may  be  projected  on  a  screen.1 

Sometimes  presentations  of  this  sort  are  made  by  the  use  of 
models.     As  an  example:  A  few  years  ago  Mr.  Carl  W.  Dipman, 

-   l  Equipment  to  enlarge  and  project  opaque  objects  on  a  screen  is  made  by 
The  Charles  Beseler  Company  of  New  York. 
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Editor  of  the  Progressive  Grocer,  campaigning  for  more  efficient 
arrangement  of  retail  grocery  stores,  designed  a  small-scale  model 
of  a  store  in  which  was  embodied  the  result  of  an  exhaustive  study 
of  the  ideal  requirements.  Everything  that  belonged  in  such 
an  ideal  store  was  provided  for  the  model  in  miniature.  All  the 
parts  were  movable.  Beginning  with  the  base,  representing 
the  floor,  walls  and  front — the  roof  being  off — Mr.  Dipman  built 
the  ideal  store  in  the  presence  of  his  audience  as  his  presentation 
proceeded  and,  as  he  explained  each  feature,  he  placed  it  on  the 
model  precisely  where  his  researches  indicated  it  should  be.  Not 
many  marketing  studies  can  be  presented  in  such  a  dramatic 
manner,  but  whenever  it  is  at  all  feasible  this  is  strikingly  effective. 
It  is  clear  that  in  determining  the  form  or  manner  in  which  the 
report  is  to  be  presented  a  careful  canvass  must  be  made  of  the 
characteristics  of  the  study  itself,  the  person  making  the  presenta- 
tion and  of  the  client — in  order  to  find  the  one  way  most  likely  to 
further  the  purpose  of  the  study. 

Complete  the  Report 

Whatever  method  of  presentation  may  be  adopted,  the  report 
must  necessarily  be  committed  first  to  writing.  It  is  to  be 
assumed  that  at  this  point  all  the  significant  data  will  have  been 
revised  and  collated;  that  all  the  material  will  have  been  laid  out 
ready  for  use  in  the  desired  sequence  and  all  decisions  made  as  to 
emphasis,  elaboration  and  graphic  illustration.  To  integrate 
the  whole  of  the  study  into  an  orderly  and  effective  report  is  the 
next  step. 

To  Include  the  Basic  Features.  If  the  report  is  to  carry  con- 
viction, it  must  have  several  underlying  characteristics.  The 
building  of  such  a  report  makes  the  same  demand  on  the  experi- 
ence, skill  and  care  of  the  writer  as  would  the  preparation  of  a 
series  of  full-page  advertisements.  The  presentation  is  designed 
to  make  a  sale — just  as  are  the  advertisements.  Both  procedures 
confront  the  same  problems — of  headlines,  subheads,  layout, 
text,  illustration,  size,  position  and  even  color. 

There  is,  however,  this  marked  difference :  As  a  statement  of 
actualities,  the  research  report  has  no  such  latitude  as  the 
ordinary  advertisement.  With  all  due  regard  to  the  factors  of 
expediency  and  diplomacy  imposed  upon  the  writer  by  the  cir- 
cumstances in  each  case,  the  report  must  present  the  truth 
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objectively,  disinterestedly  and  dispassionately — without  bias, 
equivocation  or  undue  special  pleading — and  yet  with  sufficient 
pressure  to  accomplish  its  purpose. 

Aside  from  the  indispensable  element  of  truth,  the  following 
are  some  of  the  underlying  characteristics  which  mark  the  effec- 
tive research  presentation: 

Conciseness.  A  bulky,  unwieldy  and  verbose  report  is  care- 
fully to  be  avoided.  What  it  has  to  say  should  be  put  into 
compact  phrases.  Paragraphs  should  be  short  and  each  should 
develop  no  more  than  one  idea.  A  brief  extract  from  a  news- 
paper study  illustrates  the  point : 

Population  within  the  corporate  limits  of and  the  number  of 

families  in  that  area  were  established  by  the  15th  Federal  Census 
(1930). 

To  this  has  been  added  the  suburban  population  immediately  con- 
tiguous to  the  corporate  limits;  the  number  of  families  being 
determined  by 

a.  A  study  made  by  The (a  competitive  newspaper). 

b.  Checked  through  the  Research  Department  of  the  and 

Telephone  Company. 

c.  Confirmed  by  sample  counts  of  the  families  in  the  several  outlying 
sections. 

Etc.,  Etc.,  Etc. 

Clearness.  The  same  example  applies  to  this  feature.  There 
can  be  no  ambiguity  or  confusion  so  long  as  each  idea  is  laid  out 
as  a  separate  unit.  The  building  of  the  report  then  becomes  a 
matter  of  integrating  the  ideas  according  to  a  predetermined 
design — as  a  mosaic  would  be  set. 

There  are,  however,  other  elements  embraced  in  this  feature  of 
clarity  involving,  principally,  the  structure  of  sentences  and  the 
selection  of  words.  It  is  to  be  presumed,  of  course,  that  anyone 
attempting  to  write  a  research  report  has  long  since  acquired  a 
fair  working  knowledge  of  these  requisites.  But  actually  that  is 
not  enough.  The  men  who  write  full-page  advertisements  for 
agencies  are  specialists  in  the  art  of  selling — through  written 
words.  The  nearer  to  this  proficiency  the  writer  of  reports  can 
come,  the  more  effective  will  be  his  work.  For  that  reason,  he 
should  fortify  himself  by  some  special  study  in  these  fields  (see 
Bibliography  at  end  of  chapter,  page  344). 
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Completeness.  Every  idea  introduced  into  the  report  should 
be  fully  developed;  every  technical  phrase  should  be  elucidated, 
every  procedure  explained,  every  comment  elaborated,  every 
argument  drawn  out  to  its  logical  conclusion.  The  ideal  report 
is  one  which  so  fully  covers  the  situation  as  to  require  nothing 
more — one  that  includes  everything  necessary  to  a  full  under- 
standing of  the  whole  and  of  all  its  parts. 

This  feature  has  two  aspects — general  and  specific.  The 
general  aspect  is  that  which  requires  that  no  material  essential 
to  the  issue  be  overlooked.  This  requirement  has  been  referred 
to  elsewhere — particularly  in  connection  with  the  Organization 
of  Data.  In  the  outline,  on  pages  2L9  to  226,  there  is  a  prac- 
tical example  of  the  care  the  research  agency  exercised  in  that 
case  to  guard  against  omissions  in  its  study.  Needless  to  say, 
every  significant  factor  which  anywhere  enters  into  the  study 
requires  some  treatment  in  the  report. 

The  specific  aspect,  of  the  feature  of  completeness,  requires 
that  each  item  in  the  report  be  carried  to  its  ultimate  necessary 
fullness.     For  instance: 

1.  Where  percentages  are  used,  the  base  must  also  be  shown — so  that  the 
reader  may,  if  so  inclined,  check  the  actual  calculation. 

2.  Where  an  average  is  referred  to,  the  type  of  average — arithmetical, 
medium,  mode,  etc. — must  be  mentioned;  and  a  footnote  should  be 
used  to  explain  in  nonmathematical  terms  what  that  particular  type 
of  average  means. 

3.  Any  technical  terms  or  words  having  special  meanings  should  be 
defined,  in  order  that  the  reader's  understanding  may  be  as  complete 
as  that  of  the  report  writer. 

4.  If  citations  are  used,  they  should  be  quoted  or  paraphrased  at  sufficient 
length  to  carry  the  borrowed  thought  to  the  client's  complete  under- 
standing. The  client  should  have  before  him  the  whole  idea  or  as 
much  of  it  as  is  necessary  to  show  its  application  to  his  own  problems; 
he  should  be  required  to  do  no  reference  work  whatever.  Citations 
and  other  references  may  be  put  in  the  body  of  the  report,  in  footnotes 
or  in  addenda.  If  put  in  footnotes,  the  familiar  academic  system  of 
annotation  should  be  followed. 

5.  There  should  be  a  full,  nontechnical  explanation  of  any  statistical 
procedures  which  may  have  been  used.  These,  too,  may  be  put  in 
footnotes  or  in  addenda;  but  they  should  be  sufficiently  detailed  to  give 
the  client  some  knowledge  of  the  process  and  some  confidence  in  its 
reliability.  For  instance:  In  a  given  study  one  might  use  "standard 
deviation"  as  a  means  of  determining  the  adequacy  of  sample.  If  so, 
the  term  should  be  explained  as  simply  as  possible,  in  a  footnote,  along 
some  such  lines  as  these: 
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"Standard  deviation"  is  an  established  statistical  process  for  measur- 
ing the  accuracy  of  a  result  in  sampling.  It  means,  in  general  terms, 
that  for  the  number  of  interviews  held  in  this  study  the  percentage 

of  "Yes"  or  "No"  responses  to  question have  about  sixty-seven 

chances  in  a  hundred  of  being  correct  within per  cent  (once  the 

"Standard  deviation")  and  about  ninety-five  chances  in  a  hundred 

of  being  correct  within per  cent  (twice  the  "Standard  deviation"). 

This  is  sufficiently  accurate  for  a  study  of  this  sort  and  indicates 
that  for  all  practical  purposes  the  sample  was  statistically  adequate. 
Further  sampling  would  have  made  no  justifiable  difference  in  the 
probable  accuracy. 
Even  with  such  an  explanation,  however,  the  client  would  probably 
grasp  more  easily  the  significance  of  the  "stabilization  chart"  referred 
to  on  pages  54  to  56  inclusive.     And,  if  such  a  method  is  used,  some 
such  explanation  as  the  following  should  be  set  down  in  a  footnote: 
This  graph  is  computed  by  taking  the  questionnaires  cumulatively 
in  groups  of  200  and  in  the  order  of  their  return  by  the  reporters. 
The  point  at  which  the  curves  become  stable  marks  the  number  of 
interviews  adequate  for  sample  purposes.     It  is  a  well-established 
statistical  principle  that  beyond  such  a  point  the  sampling  might  be 
continued  indefinitely  without  affecting  the  fluctuations  to  any  mate- 
rial extent. 
In  connection  with  statistical  procedures  there  are,  of  course,  circum- 
stances under  which  a  complete  mathematical  demonstration  should 
be  given,  to  show  beyond  question  the  suitability,  the  soundness  and 
the  reliability  of  the  process.    This  practice  has  been  exemplified  by 
Starch  in   some   of  his   studies   of   overlap   among   newspapers   and 
magazines.1    Care    must    be    taken,    however,    not    to    overdo    such 
mathematical   demonstrations   and  in  ordinary  commercial  research 
they  should  probably  be  avoided  entirely. 

accuracy.  Accuracy  is,  of  course,  a  concomitant  of  truth. 
It  is  stressed,  here,  however,  as  a  caution  against  distortions 
which  may  be  merely  thoughtless  or  accidental.  Any  failure 
of  accuracy  arising  deliberately  and  otherwise  than  by  inadvert- 
ence must  be  regarded  as  a  culpable  deception.  The  injunction 
here  is  to  present  the  data  just  as  they  stand  and  to  lead  up  to 
the  conclusions  precisely  as  they  have  been  arrived  at  in  the  stage 
of  interpretation. 

consistency.  To  result  in  any  benefit,  the  research  report 
must  be  believed.  To  achieve  the  necessary  credibility,  it  must 
have  in  some  sufficient  degree  all  the  features  so  far  discussed 
and  it  must  also  "hang  together "  as  a  unit.     If  any  part  of  a 

1  For  example,  the  several  studies  made  by  Dr.  Starch  in  Philadelphia  and 
other  large  cities,  under  the  auspices  of  the  American  Association  of  Adver- 
tising Agencies. 
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report  should  be  loosely  put  together  and,  as  a  consequence, 
should  expose  the  reader  to  even  a  slight  feeling  of  insecurity 
or  of  doubt,  it  would  necessarily  reflect  upon  the  entire  work  and 
to  that  extent  diminish  its  effectiveness. 

positive  statement.  Nothing  so  challenges  belief  as  a  vague, 
groping  or  negative  attitude.  A  research  report  is  based  upon 
factual  data.  If  those  data  have  been  competently  interpreted, 
the  conclusions  should  be  deliberate  and  definite.  And  the 
report  should  state  those  conclusions  positively  for  what  they  are. 

Expressions  such  as  "the  data  seem  to  show"  or  "they  appear 
to  mean"  or  "this  might  indicate"  should  be  avoided,  if  possible. 
"The  data  show,"  "they  mean,"  "this  indicates"  are  so  much 
more  convincing.  Where  the  subject  is  palpably  speculative, 
however,  or  where  the  data  are  susceptible  of  more  than  one 
interpretation,  such  definite  declarations  may  be  entirely  mis- 
leading. In  such  cases,  the  report  can  still  be  positive  in  its 
statements  of  the  uncertainties  in  the  situation. 

To  Procure  Effective  Arrangement.  To  begin  with,  there 
can  be  no  such  thing  as  one  standard  formula  for  the  arrangement 
of  all  research  presentations.  As  a  result  of  continuous  practice, 
some  few  ideas  seem  to  have  acquired  fairly  wide  acceptance 
but  even  these  may  need  changing  to  conform  with  the  circum- 
stances in  each  case.  If  marketing  research  is  to  fulfill  its  func- 
tion as  an  aid  to  management,  its  dominant  effort  must  be  to 
produce  constructive  results.     That  is  the  controlling  idea. 

It  is  generally  to  this  end  that  specific  studies  are  undertaken — 
that  the  significant  facts  are  so  carefully  collected,  organized  and 
interpreted — that  time  and  effort  and  money  are  expended  so 
freely.  It  is  just  common  sense,  therefore,  to  set  the  study  up 
and  present  it  in  such  a  manner  as  most  surely  to  bring  its  ulti- 
mate objectives  to  the  point  of  accomplishment.  This  result 
in  each  study  is  immeasurably  more  important  than  mere  adher- 
ence to  any  conventional  arrangement  or  practice. 

Nevertheless,  for  convenient  and  orderly  study,  the  arrange- 
ment of  research  reports  must  here  be  considered  according  to 
some  fairly  definite  pattern.  It  is  only  by  such  a  method  that 
one  can  be  sure  of  a  comprehensive  treatment  of  the  whole  sub- 
ject. But  before  discussing  the  disposition  of  the  research 
material,  a  few  words  should  be  said  regarding  some  of  the  phys- 
ical features  of  the  report. 
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In  treating  of  the  " basic  features"  an  analogy  was  drawn 
between  the  preparation  of  a  research  report  and  of  a  full-page 
advertisement.  It  was  pointed  out  that  headlines,  subheads,  lay- 
out, text,  illustration,  size — are  all  important  in  both  operations. 

In  the  research  presentation  one  speaks  of  "titles"  and  " sub- 
titles." In  a  somewhat  restrained  way,  they  must  be  just  as 
crisp,  clear,  significant,  arresting  and  provocative  as  the  headlines 
and  subordinate  headings  in  an  advertisement.  These  qualities 
can  be  imparted  to  the  work  only  by  considering  carefully  the 
sales  function  the  report  is  to  perform  and  by  composing  the 
captions  to  promote  that  function.  When  no  sales  function  is 
entailed,  the  same  care  is  made  necessary  by  the  need  for  clarity. 

The  layout,  as  applied  to  the  research  report,  has  to  do  with 
the  manner  in  which  the  work  is  spread  upon  the  pages.  This  is 
largely  a  matter  of  individual  taste  and  practice.  Where  the 
report  is  to  be  typed,  there  is  no  great  scope  for  interesting  pres- 
entation; but  where  it  is  to  be  printed,  the  possibilities  are  limited 
only  by  the  resources  of  the  printer's  craft.  In  either  case,  layout 
of  the  pages  is  one  of  the  elements  of  a  report  requiring  delibera- 
tion and  one  which  may  add  greatly  to  the  effect  upon  the  client. 

The  "text"  is  usually  in  typewriting — in  which  event  the 
reading  column  should  not  be  more  than  5  to  53^  inches  in  width. 
And  there  should  be  considerable  margin  at  the  tops  and  bottoms 
of  the  pages — 2  inches  at  the  top  and  1}4  inches  at  the  bottom. 
Nothing  so  discourages  the  reading  of  a  lengthy  report  as  over- 
crowded pages,  long-winded  paragraphs  and  wide  reading 
columns.  It  is  better  to  take  a  few  pages  more  and  present  the 
study  in  the  form  most  conducive  to  comfortable  reading. 

One  of  the  moot  questions  is  whether  the  typing  should  be 
single  or  double  spaced.  Some  persons  stick  to  double  spacing 
as  though  it  were  an  article  of  faith.  Double  spacing  is  necessary 
where  the  work  is  to  be  printed  or  where  interlineations  are  liable 
to  be  made.  Otherwise,  where  the  reading  column  is  sufficiently 
narrow  for  easy  reading,  it  is  practical  to  use  single-space  typing — 
with  only  the  paragraphs  double  spaced.  This  is  entirely  accept- 
able, too.  Single  spacing  brings  the  lines  no  closer  together  and 
is  no  harder  to  read  than  ordinary  newspaper  typography,  which 
constitutes  the  major  part  of  most  businessmen's  reading,  and,  in 
an  extensive  report,  it  reduces  the  bulk  by  cutting  the  number  of 
pages   almost   in   half.     Further,   being   more   compact,   single 
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spacing  lends  itself  to  more  attractive  composition  of  the  page. 

In  research  presentations,  the  " illustrations' '  are  the  tables, 
graphs,  charts  and  other  pictorial  devices.  These  forms  are  so 
important  a  part  of  the  successful  report  that  they  will  presently 
be  treated  as  a  separate  subject. 

The  question  of  size  has  been  covered  in  discussing  the  feature 
of  conciseness.  Principally,  the  report  must  not  be  too  bulky. 
Features  such  as  color  effects,  quality  of  the  paper  used,  the 
kind  of  cover  or  binding  and  all  other  characteristics  which  have 
to  do  with  the  appearance  of  the  report  must  be  thought  out  with 
conscious  care.  In  every  respect  the  presentation  must  be 
presentable. 

As  a  matter  of  " arrangement,"  immediately  preceding  the 
research  material  in  the  report  there  should  be  placed  a  title 
page  and  a  table  of  contents.  The  title  page  is  simple  enough  in 
purpose  and  form  but  there  are,  nevertheless,  the  following 
several  principles  involved  in  preparing  it : 

1.  The  title  must  tell  exactly  what  the  study  is  about.  This  does  not,  of 
course,  mean  a  description.  It  is  only  a  title  but  it  should  suggest  no 
more  and  no  less  than  the  study  actually  covers. 

2.  If  the  title  involves  several  ideas,  each  idea  should  be  set  up,  if  possible, 
as  a  separable  typographical  unit — so  that  each  thought  stands  out 
independently  of  the  others.     For  example:  » 

A  SURVEY  (tells  what  it  is) 

of  the 
SEVERAL  NEWSPAPERS         (tells  of  what  the  survey  treats) 
in 
EMPORIA,  KANSAS  (tells  where  the  survey  was  made) 

as  to  their 
ADVERTISING  INFLUENCE     (tells  what  feature  was  studied) 
in  the 

HOME  (tells  the  special  field  of  influence 

examined) 

By  way  of  contrast,  the  same  title  page  might  have  been  written  thus: 

A  SURVEY  OF  THE  SEVERAL 

NEWSPAPERS  IN  EMPORIA, 

KANSAS,  AS  TO  THEIR  ADVERTISING 

INFLUENCE  IN  THE  HOME. 

It  will  be  seen  that,  while  both  forms  contain  the  same  information, 
the  ideas  in  the  latter  example  are  slurred  over  from  one  line  to  the 
next  and  that  it  fails  to  give  instantly  the  clear,  full  "headline"  effect 
that  a  caption  or  a  title  page  should  have.     Another  example: 
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A  REPORT  (tells  what  it  is) 

on  the 

MARKETING  POSITION 

an(j  (tells    the   subject  matter) 

REQUIREMENTS 

of  the 
JOHN  DOUGH  BAKING  COMPANY     (tells    whose    interests    are 

involved) 
in  the  New  York  Area  (tells  where  those  interests 

lie) 

It  will  be  noted  that  in  these  examples  each  element  in  the  title  is  an 
independent  and  complete  thought  in  itself.  With  a  little  care  it  is 
possible  in  practically  every  case  to  set  the  title  up  in  such  a  manner. 

3.  The  title  page  should  also  state  when  the  study  was  made.  Where 
time  is  a  factor,  the  exact  dates  on  which  the  study  began  and  ended 
should  be  cited;  under  other  circumstances  it  might  be  permissible 
simply  to  state  the  month  and  the  year,  as: 

Conducted  during  May,  Nineteen  Thirty-Six 

or 

Made  in  May  and  June, 

Nineteen  Thirty-Six. 

4.  The  name  and  address  of  the  agency  which  conducted  the  study  should 
certainly  appear. 

The  table  of  contents  should  be  adequate  to  its  purpose.  It 
should  show  all  the  major  divisions  and  subheadings  and  should 
be  so  set  up  as  to  facilitate  reference  to  any  subject  in  the  book. 
A  very  large  report,  embracing  a  wide  range  of  subjects, 
may  require  also  an  index — listing  under  topics,  alphabetically- 
arranged,  every  related  subdivision  and  giving  the  page  on  which 
it  is  treated.  An  example  of  this  index  feature  can  be  found, 
usually  at  the  back,  in  practically  every  volume  of  reference 
material. 

The  research  report  proper  may  be  considered  in  parts.  In 
Part  One  should  be  put  all  such  fundamental  features  of  the 
study  as  are  essential  to  a  clear  understanding  of  the  work. 
These  features  may  differ  with  each  study,  but  generally  they 
include  the  following: 

1.  A  statement  of  the  problem  or  purpose  of  the  study — so  that  anyone 
who  may  read  the  report  will  know  exactly  what  it  is  intended  to  show 
or  do. 

2.  A  description  of  the  method  employed  in  the  study — so  that  the  reader 
may  form  his  own  estimate  as  to  whether  or  not  the  results  of  such  a 
method  may  be  relied  upon. 
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3.  A  statement  as  to  the  fitness,  the  experience  and  the  equipment  of  the 
individuals  who  did  the  work — so  the  reader  may  determine  for  himself 
the  credibility  of  the  results. 

In  this  opening  part  of  the  report,  too,  should  be  put  any  other 
information  which  may  affect  the  client's  or  reader's  understand- 
ing and  judgment  of  the  work.  For  instance,  in  some  cases  the 
reason  or  motive  for  making  the  study  may  be  important  as  bear- 
ing on  the  credibility  of  the  report.  A  study  made  purely  in 
the  public  interest  is  worthy  of  considerably  more  credence  than 
one  designed  solely  to  sell  an  idea.  For  similar  reasons,  a  state- 
ment should  be  made  concerning  any  relationship  which  may  exist 
between  the  sponsor,  the  person  paying  for  the  study,  and  the 
institution  making  it,  or  regarding  any  special  interest  the  sponsor 
may  have  in  the  result.  Anyone  likely  to  be  influenced  by  the 
report  is  entitled  to  such  information  without  reservation. 

If  the  study  involves  extensive  field  work,  there  should  be 
a  statement  in  Part  One  as  to  how  this  field  work  was  con- 
ducted; what  routine  was  followed;  how  the  work  was  supervised, 
inspected  and  tabulated.  In  such  studies  it  is  necessary 
also  to  describe  the  localities  in  which  the  survey  was  made;  to 
state  how  the  interviews  were  distributed;  what  kinds  of  homes, 
people  or  stores  were  called  upon;  and  other  such  details. 

If  the  study  rests  upon  samples,  it  is  customary  to  place  in 
Part  One  an  explicit  description  of  the  method  by  which  a  true 
cross  section  was  arrived  at  and  of  the  principle  by  which  the 
adequacy  of  the  sample  was  determined. 

All  these  points  should  be  covered  in  crisp,  short  statements. 
But  they  should  be  there.  The  interpreter  and  the  writer  of 
the  report  have  full  knowledge  of  all  these  operating  details. 
This  knowledge,  indeed,  forms  the  background  upon  which  all 
the  research  material  is  projected.  If  the  client  or  other  reader 
is  to  have  the  same  basis  for  his  judgment,  he  must  have  the  same 
background  and,  like  the  original  makers  of  the  report,  he  ought 
logically  to  have  it  before  he  begins  to  consider  and  weigh  the  data. 

In  Part  Two  of  the  presentation  a  great  many  reports  disclose 
the  conclusions  arrived  at  as  a  result  of  the  study;  that  is,  of 
course,  if  the  study  calls  for  conclusions.  Some  do  not.  For 
example:  A  study  of  the  influence  of  several  newspapers  as  adver- 
tising media  in  a  market  may  be  more  effective  in  the  selling  of 
space  if  it  simply  presents  the  facts  and  leaves  each  reader  free 
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to  draw  his  own  conclusions.  In  such  a  study  it  may  be  imprac- 
ticable to  draw  any  conclusions  at  all,  because  of  the  number,  the 
variety  and  the  sometimes  conflicting  significance  of  the  factors 
involved. 

Studies  of  a  general  nature,  too,  usually  require  no  conclusions. 
Examples  of  this  type  would  be  such  studies  as  the  Statistical 
Abstracts,  the  Census  of  Distribution  and  Real  Property  Inventory. 
These  are  all  simple  statistical  compilations,  frequently  furnishing 
raw  material  for  other  studies. 

The  practice  of  placing  summaries,  recommendations  or  con- 
clusions ahead  of  the  data  from  which  they  are  drawn  is  popular 
and  customary.  Whether  it  is  in  all  cases  the  best  practice  or 
not  is  open  to  question.  The  theory  is  that  businessmen  must 
read  as  they  run — that  they  have  no  time  to  wade  through  a  lot 
of  arguments — that  they  must  have  a  boiled-down  result  that 
they  can  snatch  up  en  passant.  Then,  if  they  can  muster  up 
sufficient  interest,  they  can  take  up  the  study  of  details  when 
they  get  around  to  it.  This  routine  is  regarded  as  requisite 
to  the  high  speed  of  the  present  business  era.  It  is  the  journal- 
istic method. 

When  applied  to  some  specific  studies,  especially  of  internal 
character,  this  practice,  however,  suggests  several  interesting 
questions : 

1.  7s  it  logical  to  present  the  conclusions  before  the  premises — to  put  the 
cart  before  the  horse? 

2.  Is  it  sound  to  expose  the  data,  comments  and  arguments  to  unpre- 
dictable influences  which  might  arise  from  the  premature  disclosure  of 
the  writer's  conclusions? 

3.  Is  it  fair  to  deprive  the  persons  in  interest  of  their  opportunity  to 
arrive  at  their  own  conclusions  by  independent  thinking,  unbiased  by 
the  previously  disclosed  conclusions  of  others? 

4.  Is  it  safe  to  expose  the  entire  study  to  condemnation  by  smug,  impul- 
sive, opinionated,  reactionary  executives — of  which  there  are  some  in 
business — or  persons  adversely  affected,  who,  finding  on  the  first  page  a 
conclusion  contrary  to  their  own  ideas',  plans  or  interests  might  read 
no  farther? 

5.  Is  it  justifiable,  when  its  maximum  benefit  can  be  nothing  more  than 
the  saving  of  perhaps  five  seconds  of  time — the  time  necessary  to  turn 
to  the  back  of  the  report  if  the  man  persists  in  having  the  end  before  the 
beginning? 

Where  a  study  concerns  conditions  or  matters  out  in  the  field — 
such  as  "which  of  several  copy  themes  is  likely  to  prove  most 
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effective"  or  "what  is  the  sales  potential  for  product  X  in  Y 
market" — it  can  make  little  difference  where  the  conclusions 
are  placed  in  the  report.  In  the  extensive  external  survey 
referred  to  on  page  219  and  the  several  following  pages,  the 
situation  was  met  by  putting  the  complete  summary  and  the 
recommendations  in  a  separate  volume. 

Where,  however,  the  study  reaches  into  the  intimate  folds  of 
a  business,  as  much  true  marketing  research  does,  and  where  it 
touches  the  abilities,  the  interests  or  the  dignity  of  its  administra- 
tive functionaries,  it  is  probably  more  effective  to  place  the 
conclusions  either  in  parts  at  the  end  of  each  significant  group 
of  facts  or  as  a  whole  at  the  close  of  the  report  proper. 

Then,  if  the  client  vjants  to  be  illogical,  if  he  wants  to  confuse 
his  thinking  with  the  conclusions  of  others,  if  he  wants  to  expose 
the  study  to  misunderstanding  or  futility — he  can,  on  his  own 
responsibility,  turn  over  some  of  the  pages  and  read  the  conclu- 
sions when  and  as  he  pleases.  If  the  study  should  then  fail  of 
its  purpose  no  blame  can  attach  to  the  research  man.  He  will 
have  given  his  client,  at  least,  the  opportunity  to  think  his  prob- 
lem through  logically,  independently  and  constructively. 

It  would  be  difficult,  if  not  impossible,  to  prove  but  it  is  con- 
ceivable that  some  part  of  the  deplored  waste  in  distribution  is 
due  to  clients'  disregard  of  perfectly  sound  marketing  research; 
their  flat  rejection  of  disagreeable  conclusions,  prematurely 
presented  and  hastily  condemned;  and  their  failure,  from  sheer 
inertia,  to  put  their  own  thinking  equipment  to  work  objectively 
and  constructively  on  facts  and  conditions  proven  to  affect  their 
business. 

The  thing  to  bear  in  mind  in  the  more  subtle  cases  is  that,  as 
has  been  stated  before,  the  research  presentation  has  a  sale  to 
make.     The  logical  steps  in  this  selling  process  are: 

1.  To  awaken  in  the  client  a  clear  understanding  and  appreciation  of  the 
situation  as  it  actually  exists.  This  can  be  accomplished  only  by  a 
factual  presentation— by  laying  before  the  client  first  a  convincing 
array  of  facts. 

2.  To  picture  the  situation  so  clearly  as  to  make  the  client  want  to  do 
something  about  it.  This  can  be  accomplished  only  by  contrasting 
things  as  they  are  with  a  vision  of  what  they  might  be  made  to  be.  The 
client  must  recognize  an  advantage  and  want  it. 

3.  Only  when  the  client  has  arrived  at  a  voluntary,  interior  and  imper- 
ative urge  to  do  every  rational  thing  necessary  to  achieve  such  an 
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advantage  can  he  safely  be  told  the  price — that  is,  the  things  he  must 
do  to  attain  that  desired  advantage. 

This  is  the  procedure  employed  in  making  sales  of  merchandise. 
To  reverse  the  process,  as  is  so  often  done  in  research  presenta-' 
tions — to  confront  the  prospect  immediately  with  the  price — is 
one  likely  way  to  kill  the  opportunity.  The  prospect,  or 
client,  does  not  yet  know  what  is  being  offered — or  why;  he  has 
as  yet  no  understanding  or  appreciation  of  what  it  may  do  for 
him;  he  has  no  sense  of  need  for  the  thing;  but  he  does  know  what 
the  price  entails — or  its  equivalent  demand  on  his  initiative,  his 
ingenuity,  his  resolution,  his  time,  energy  and  convenience.  He 
knows  what  risks  that  price  involves  and  what  it  will  do  for  him 
in  easier  and  more  familiar  directions.  So,  following  the  well- 
worn  path  of  "least  resistance,"  he  turns  away  and  the  sale  falls 
through. 

Such  a  system  of  selling  is  palpably  unscientific  and  ineffectual. 

In  those  cases,  therefore,  where  the  study  shows  some  positive 
or  corrective  action  to  be  necessary,  it  would  seem  advisable 
to  break  away  from  the  conventional  practice;  to  present  first 
a  digest  of  the  data,  with  only  such  brief  comments  and  argu- 
ments as  are  clearly  essential,  and  then  gradually  to  lead  the 
client  up  to  the  conclusions  and  recommendations — by  the  same 
logical  steps  by  which  the  research  man  himself  arrived  at  them. 
The  client  should  be  urged  to  think  out  his  conclusions  inde- 
pendently, as  he  studies  his  way  through  the  report,  and  even  to 
commit  his  conclusions  to  writing. 

In  this  way  the  client  can  check  his  deliberations  with  those  of 
the  research  man  and  determine  by  his  own  experience  and 
reasoning  process  the  validity  of  the  recommendations,  when 
he  finally  reaches  that  point  in  the  report.  This  would  be  the 
best  way  to  read  a  research  presentation  of  that  type;  it  would 
best  promote  the  client's  own  interests  and,  unquestionably,  it 
would  enhance  the  efficacy  of  marketing  research  as  an  instrument 
of  management. 

Where  Part  Two  of  the  report  is  not  used  to  convey  the  con- 
clusions and  recommendations,  it  should  be  devoted  to  an  exposi- 
tion of  the  data  found  in  the  survey.  It  would  be  impractical,  of 
course,  to  include  the  material  in  all  its  detail.  The  custom  is 
rather  to  present  a  digest  of  the  various  significant  groups  of 
material,  including  necessary  tables  and  elaborating  text,  leaving 
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the  bulk  of  the  detail  for  presentation  later.  Figures  46  and  47 
are  examples. 

It  is  in  this  section  of  the  report,  Part  Two,  that  the  tables, 
graphs,  charts  and  other  illustrative  devices  are  generally  to  be 
included.  They  may  appear  in  juxtaposition  with  the  relevant 
text  or,  under  some  circumstances,  they  may  be  set  apart  in  a 
section  of  their  own,  properly  related  to  the  text  by  captions 
and  explanatory  notes.  Some  special  notes  on  graphic  presenta- 
tions will  be  presented  later. 

The  various  digests  of  data  and  illustrative  material,  presented 
in  Part  Two  of  the  report,  must  be  sufficient  in  number  and 
thought  content  and  they  must  be  arranged  in  such  a  manner 
as  to  give  the  reader  an  ample  and  secure  foundation  for  conclu- 
sions of  his  own.  It  was  by  a  study  of  these  same  digests,  con- 
sidered in  the  same  sequence,  that  the  original  interpreter  arrived 
at  his  convictions.  The  client  or  subsequent  reader  should  follow 
the  same  course  and,  if  his  reasoning  coincides  with  that  of  the 
first  interpreter,  they  must  necessarily  arrive  at  the  same  con- 
clusions. If  not,  they  should  endeavor  at  once  to  reconcile  any 
differences  in  their  respective  convictions;  certainly,  they  should 
be  in  agreement  before  any  action  is  taken  on  the  report. 

Part  Three  of  the  research  report  may  be  devoted  to  such 
additional  material  or  information  as  may  assist  the  client  or 
other  person  in  his  reading  and  judgment  of  the  study.  There 
should  be  included,  for  instance,  a  copy  of  the  questionnaire  used 
in  the  study,  perhaps  with  notes  explaining  any  question  whose 
purpose  or  implication  is  not  entirely  clear.  In  some  reports 
the  questions  are  identified  immediately  with  tables  or  with  text 
by  footnotes,  such  as : 

These  data  are  drawn  from  "call  reports"  and  represent  the  replies  to  a 
series  of  categorical  questions  (Nos.  15,  16  and  18  on  sample  "call  report" 
which  appears  printed  in  Part  Three  of  the  report)  and  also  from  the 
reporters'  observations  as  to  the  "type  and  character  of  store"  (items  19 
and  20  on  call  report). 

The  idea  of  so  placing  these  notes  is  to  leave  no  doubt  in  the 
mind  of  any  reader  as  to  just  how  the  data  were  gathered.  He 
can  refer  at  once  to  the  precise  question  and  determine  in  his 
own  mind  its  suitability,  its  position  in  the  schedule  and  its 
structure. 
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COMPARATIVE  CIRCULATION 

(BY    INCOME    GROUP AS    SHOWN   BY    SAMPLE) 


Income  Group 


Number 
Calls 


Morning  Paper 
Number     Percentage 
Readers        of  Cir. 


Evening  Paper 
Number     Percentage 
Readers         of  Cir. 


AA"  ($7,500  and  over) 147 

A"      ($5,000-$7,499) 606 

BB  "  ($3,500-$4,999) 444 

B"      ($2,000-$3,499) 1,563 

C"      ($1,000-$1,999) 1.427 

D"     ($0,00-$999) 835 

Totals 5 ,  022 


131 
547 
394 
1,130 
925 
410 


89 . 12  % 
90 . 26  % 
88.74% 
72.29% 
64 . 82  % 
49 . 10  % 


3,537         70.43 


140 

563 

418 

1,417 

1,217 

700 

4,455 


95.23  % 
92 . 90  % 
94.14  % 
90 . 66  % 
85.28% 
83.83% 

88.71  % 


The  questions  used  to  establish  the  number  of  readers  were: 


"1.   Do  you  read  a  morning  paper_ 
(Regularly,  day  after  day.) 

"2.  Do  you  read  an  evening  paper_ 
(Regularly,  day  after  day.) 


Name  of  paper 


Name  of  paper 


DISTRIBUTION  OF  CIRCULATION 

APPLYING  THE  SAMPLE  PERCENTAGES  TO  TOTAL  NUMBER  OF    FAMILIES  IN  THE  SEVERAL  INCOME  GROUPS 


Income  Group 


Families 


A.  M.  Paper 


P.  M.  Paper 


"AA"  ($7,500  and  over) 1,713         89.12  %  1,526 

"A"      ($5,000-$7,499) 4,800         90.26%  4,332 

"BB"  ($3,500-$4,999) 2,793         88.74%  2,479 

"B"      ($2,000-$3,499) 14,858         72.29%  10,740 

"C"      ($1,000-81,999) 14,912         64.82%  9,666 

"D"     ($0,00-$999) 7,308         49.10%  3,588 

Scattered  Families 1,659         70.43%  1,168 

Self-Duplication 1-33%  450 

Total  Families 48,043  33,949 

Total  City  Circulation  (A.  B.  C,  3/31/31) 34,277 

Variances 0.95%  328 


95.23  ' 
92.90 
94.14 
90.66 
85.28 
83.83 
88.71  ' 
2.6  95 


1,631 
4,459 
2,629 
13,470 
12,717 
6,126 
1,461 
1,254 

43,747 


9.11 


48,131 
4,384 


Note:  Some  part  of  the  variance  in  the  figures  for  the  Evening  Paper  is  due  to  its  larger  "street 
|e  "—consideration  of  which  is  not  included  in  this  study  of  newspaper  advertising  influence 
the  home. 

Notes  on  Distribution  of  Circulation 


By  "Scattered  Families"  is  meant  the  aggregate 
of  families  living  within  the  corporate  limits  but 
apart  from  any  of  the  populous  areas.  These 
families,  their  numbers  and  locations,  are 
marked  on  the  map  of  Income  Groups. 


By  "Self-Duplication"  is  meant  the  number  of 
families  whose  spokesman  stated  that,  in  addition 
to  the  papers  read  by  themselves,  some  other 
member  of  the  same  household  habitually  brought 
another  copy  of  the  same  paper  into  the  home. 


Fig.  46. — Sample  page  of  report  on  a  newspaper-reader  survey. 
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SAMPLE  PAGE  OF  A  REPORT 

Presented  in  Connection  with  an  Internal  Marketing  Study 

Distribution 

A.  Total  Sales  of  Products  under  Discussion. 

(Ref.  Part  IV,  Work  Sheet  Two,  #18) 

Sales  during  1934  on  the  items  under  review  totaled  189,138  units. 

Distributed — as  to  class  of  trade — as  follows: 

Type  A  Customers —  28,588  units,  equals  15.12% 

Type  B  Customers —  51,361  units,  equals  27.16% 

Type  C  Customers —  40,490  units,  equals  21.41% 

Type  D  Customers—  38,952  units,  equals  20.59% 

Type  E  Customers —  29,747  units,  equals  15.72% 


189,138 


100.00% 


B.  Distributed — as 

to  products — as  follows: 

Customers 

Products 

Type 

Type 

Type 

Type 

Type 

Total 

Per 

A 

B 

C 

D 

E 

cent 

Product  R 

4,258 

36,419 

11,161 

12,785 

7,519 

72,142 

38.19 

Product  S 

6,457 

79 

20,850 

15,993 

9,771 

53,150 

28. 10 

Product  T 

1,790 

5,326 

145 

600 

2,019 

9,880 

5.22 

Product  U 

2,769 

75 

12 

1,639 

2,432 

6,927 

3.65 

Product  V 

3,159 

7,979 

669 

1,726 

2,827 

16,360 

8.64 

Product  W 

443 

139 

368 

311 

1,261 

.66 

Product  X 

3,865 

99 

6,904 

3,448 

3,730 

18,046 

9.54 

Product  Y 

2,270 

857 

749 

2,393 

1,138 

7,407 

3.91 

Product  Z 

3,577 

388 

3,965 

2.09 

28,588 

51,361 

40,490 

38,952 

29,747 

189,138 

100.00 

(Ref.  Part  IV,  Work  Sheet  Two,  #1,  5,  16-B  and  C,  and  14) 


Fig.  47. — Presenting  data  in  digest  and  referring  to  work  sheets  for  all  details. 
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Where  circumstances  require  it,  some  statement  should  be 
made  in  Part  Three  regarding  the  number  and  distribution  of 
interviews  and  setting  forth  additional  evidence  of  their  relia- 
bility. This  latter  is  something  more  than  proving  the ' '  adequacy 
of  sample/'  as  previously  referred  to;  it  sets  forth,  generally,  some 
practical  reasons  for  accepting  the  sample  as  reliable.  The 
following  is  an  extract  from  a  report  to  illustrate  this  point: 

In  order  to  procure  a  sample  that  would  bear  a  uniform  relation  to  the 
population  in  each  income  area,  and,  further,  to  prevent  any  possible 
" hand-picking"  of  interviews,  the  field  work  in  this  survey  was  based 
upon  an  interview  in  every  eighth  house  throughout  the  city  and 
suburbs — regardless  of  the  size,  character  or  condition  of  that  house  and 
regardless  of  the  color,  character  or  condition  of  its  occupants. 

That  this  regulation  was  well  chosen  and  well  maintained  is  evidenced 
by  these  facts:  That  the  sample  for  the  city  and  suburbs,  when  com- 
pleted, represented  10.45  per  cent  of  the  total  number  of  families;  that 
it  proved  adequate  for  each  of  the  income  groups;  that  its  showing  as  to 
the  two  races  (white  and  colored)  very  closely  conforms  to  the  known 
ratio  in  the  city's  population;  that  it  provided  reasonable  percentages 
of  all  the  major  occupations  and  conditions  of  family  life;  and  that  on 
the  one  paper  whose  home  circulation  is  definitely  known,  the  sample 
checked  within  one  per  cent  of  its  A. B.C.  circulation. 

It  might  be  advisable,  too,  to  insert  in  this  part  of  the  report 
some  appropriate  notes  on  the  instructions  to  the  field  staff.  This 
is  to  set  the  client  at  rest  as  to  just  how  the  staff  proceeded  with 
its  work.  These  notes,  when  included,  should  show  how  the 
reporters  were  instructed  on  such  points  as  the  following: 

1.  How  to  distribute  their  calls — as  to  locality. 

2.  What  individuals  they  were  to  interview — proprietors,  managers, 
housewives;  and  what  individuals  to  avoid — children,  aged  persons, 
servants. 

3.  How  the  reporters  were  to  approach  the  respondents — the  mental 
attitude. 

4.  How  they  were  to  introduce  their  mission. 

5.  Specifically,  how  each  question  should  be  asked  and  what  sort  of  replies 
to  regard  as  adequate. 

6.  What  personal  observations  to  make  and  what  standard,  if  any,  should 
guide  such  observations. 

7.  What  precautions  the  workers  were  to  take  against  bias — particularly 
against  reflecting  their  own  beliefs  and  preferences,  even  inadvertently.  - 
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8.  How  the  field  staff  was  to  work  with  supervisors  and  what  "inspection" 
procedure  would  be  applied  to  their  work. 

The  purpose  of  all  this  is  that  the  client  or  other  reader  may 
see  for  himself  what  safeguards  were  erected  against  slipshod 
or  incompetent  work.  It  is  an  important  part  of  the  process  of 
building  credibility  for  the  results. 

Part  Four  of  the  report  contains,  usually,  all  the  pertinent 
material  which  has  not  been  utilized  in  other  sections,  all  work 
sheets  from  which  the  digests  in  Part  Two  were  drawn  and  any 
other  data  or  information  necessary  to  round  out,  qualify  or 
confirm  any  of  the  other  phases  of  the  study. 

Graphic  Forms  and  Effects.  The  Chinese  are  credited  with 
the  now  trite  aphorism,  "  One  picture  is  worth  a  thousand  words." 
Its  wisdom  is  obvious  and  it  has  a  very  direct  application  to 
marketing  research.  Throughout  this  work  the  idea  has  been 
maintained  that  any  man  who  assumes  responsibility  for  the 
conduct  of  a  business  should  be  able  and  willing  to  concentrate 
on  a  research  presentation  sufficiently  to  extract  its  maximum 
benefit.  His  patience,  however,  and  his  time  are  not  wantonly 
to  be  imposed  upon.  It  is  the  duty  of  the  research  man  so  to 
present  his  study  as  to  make  its  comprehension  immediate  and 
certain.  He  can  greatly  aid  this  result  by  a  liberal  use  of  tables, 
graphs.,  charts  and  other  pictorial  effects. 

the  table.  This  is  a  formal  arrangement  of  homogeneous 
data  into  rows  and  columns  which  can  be  read  in  two  directions. 
The  purpose  of  this  form  is  to  disclose  the  relationships  which 
exist  in  and  between  groups  of  like  data — relationships  not 
readily  to  be  perceived  in  the  confused  mass  of  figures  as  originally 
assembled. 

Tabulating  is  a  simple  process.  There  are,  however,  a  few 
principles  to  be  followed  which  have  been  generally  accepted  by 
statisticians  and  research  people  as  necessary  and  practical. 
These  are: 

1.  Order  of  Arrangement.  Except  where  otherwise  required  to 
conform  with  a  plotted  diagram,  or  for  other  good  reasons,  the 
items  should  be  arranged  according  to  size — increasing  from  left 
to  right  and  from  top  to  bottom.  Totals  are  usually  put  at  the 
bottom  of  columns,  as  in  accounting  practice,  but  this  may  be 
altered  to  meet  the  requirements  of  specific  cases  as  shown  in 
one  of  the  tables  in  the  following  series: 
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Table  I. — Number  of  Orders  by  Size    June,  1935 


Size  of  order 


Number 


Under  $10 
10  to  19 
20  to  29 
30  to      39 

40  to      49 


30 
35 
55 
50 
30 


Total 


200 


Table  II. — Frequencies  op  Orders  by  Size 


Dollars 

5 

6 

7 

8 

9 

10 

11 

12 

Frequency 

11 

14 

12 

16 

20 

17 

10 

8 

Table  III- 

-Sales  by 

Months  in 

Dollars 

Year 

Jan. 

Feb. 

Mar. 

Apr. 

May 

June 

July 

Aug. 

Sept. 

Oct. 

Nov. 

Dec. 

1933 
1934 
1935 

1,020 

990 

1,400 

1,650 

2,050 

1,950 

1,000 

900 

1,250 

1,300 

1,550 

1,950 

If  the  data  refer  to  spatial  items,  they  should  be  tabulated  in 
the  order  of  their  occurrence  in  space.  Data  concerning  the 
various  states,  for  instance,  should  not  be  listed  alphabetically 
except,  perhaps,  for  some  special  reason.  It  would  be  better,  for 
the  purpose  of  comparing  data,  to  list  the  states  in  groups,  fol- 
lowing the  order  of  their  position  within  each  group  and  moving 
from  east  to  west — the  arrangement  generally  followed  in  the 
publications  of  the  United  States  Department  of  Commerce. 
For  example: 
Table  IV. — Geographical  Analysis  of  Responses  to  a  Questionnaire 


New   England 

Me. 

N.  H. 

Vt. 

Mass. 

R.  I. 

Conn. 

Total 

200 
12 

140 
13 

100 
3 

960 
40 

100 
5 

180 
15 

1680 

88 

_.    (  Yes 

6 
6 

7 
6 

1 
2 

28 
12 

4 

1 

7 
8 

53 

Do  you  own  a  radio  1  -T 

35 
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Then  would  follow  the: 

Middle  Atlantic  states  with  N.  Y.,  N.  J.,  arid  Pa. 

East  North  Central  states  with  Ohio,  Ind.,  111.,  Mich.,  Wis. 

West  North  Central  states  with  Minn.,  Iowa,  Mo.,  N.  D.,  S.  D.,  Neb.,  Kan. 

South  Atlantic  states  with  Del.,  Md.,  D.  C,  Va.,  N.  C,  S.  C,  Ga.,  Fla. 

East  South  Central  states  with  Ky.,  Term.,  Ala.,  Miss. 

West  South  Central  states  with  Ark.,  La.,  Okla.,  Texas 

Mountain  states  with  Mont.,  Idaho,  Wyo.,  Colo.,  N.  Mex.,  Ariz.,  Utah, 

Nevada. 
Pacific  states  with  Wash.,  Ore.,  Calif. 

On  page  326  Table  V  presents  an  instance  in  which  the  account- 
ing practice  is  reversed  by  placing  the  totals  at  the  tops  of  the 
several  columns.  This  arrangement  should  be  followed  whenever 
totals  are  likely  to  be  referred  to  more  frequently  than  the 
individual  items.     Note  position  of  the  sectional  totals. 

2.  Class  Intervals.  Frequently,  the  items  presented  for  tabula- 
tion are  too  numerous  to  be  listed  singly  or  individually.  Sup- 
pose, for  instance,  the  size  of  the  orders  in  a  business  are  being 
studied.  They  might  run  from  one  dollar  to  a  thousand  dol- 
lars— with  perhaps  only  ten  or  fifteen  cents  separating  them  in 
value.  Obviously,  a  table  itemizing  all  these  sales  would  be 
cumbersome  and  uninformative. 

In  these  cases,  the  only  practical  thing  to  do  is  to  set  the  data 
up  in  classes— say,  from  .01  to  $4.99;  from  $5  to  $9.99;  from  $10  to 
$14.99  and  so  on.  This  would  represent  a  class  interval  of  $5. 
If  the  data  have  to  do  with  the  value  of  homes,  ranging  from 
$2,000  to  $20,000,  the  class  interval  might  be  fixed  as  $1,000. 

The  class  interval  is  a  necessary  basis  for  practically  all  fre- 
quency tables.  The  procedure  and  the  uses  of  frequency  tables 
can  be  found  fully  elaborated  in  any  of  the  standard  works  on 
statistics,  but  the  following  are  a  few  of  the  general  rules  govern- 
ing the  establishment  of  class  intervals : 

a.  The  size  of  the  class  interval  should  be  such  as  clearly  to  display  the 
characteristic  features  of  the  distribution. 

b.  The  class  intervals  should  not  be  so  large  that  a  considerable  error 
might  be  involved  in  assuming  the  arithmetic  average  as  the  mid-point 
of  the  interval.  The  number  of  classes  might  range  between  six  and 
thirty. 

c.  The  interval  should  not  be  so  small  as  to  give  a  frequency  of  zero  within 
the  significant  part  of  the  range.  If  the  interval  is  too  small  the 
benefits  of  the  summarization  are  lost.  Summarization  should  be 
confined  within  not  more  than  thirty  classes. 

d.  The  class  interval  should  be  of  uniform  width.  This  aids  in  making 
graphs. 
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e.  Different  distributions  can  be  compared  if  same  class  intervals  are  used. 
/.  Class  intervals  should  have  definite  limits. 

Table  V. — Value  of  Exports  of  Agricultural  Implements,  by  Grand 

Divisions  and  Principal  Countries  of  Destination 

(In  thousands  of  dollars) 


Grand  division  and  country 


Total 

Europe 

France 

Italy 

Russia  in  Europe . .  . 

United  Kingdom 

All  other 

North  America 

Canada 

Mexico 

Cuba 

All  other 

South  America 

Argentina 

Brazil 

All  other 

Asia 

British  India 

Japan2 

Philippine  Islands . . 

Russia  in  Asia 

Turkey  in  Asia 

All  other 

Oceania 

Australia 

New  Zealand 

All  other 

Africa 

British  South  Africa 

Algeria  and  Tunisia . 

All  other 


1913 

1924 

1927 

1928 

42,991 

59,649 

90,747 

116,651 

20,237 

17,887 

21,501 

22,176 

4,146 

7,227 

2,949 

1,923 

426 

1,376 

2,477 

1,590 

6,879 

628 

5,110 

7,159 

1,208 

1,953 

2,420 

2,411 

7,578 

6,703 

8,545 

9,093 

10,511 

11,110 

33,864 

49,884 

9,618 

7,498 

30,440 

46,132 

435 

1,482 

1,652 

2,105 

316 

1,499 

981 

812 

142 

631 

791 

835 

8,018 

19,935 

19,537 

24,256 

6,596 

17,213 

16,540 

20,817 

366 

694 

413 

813 

1,056 

2,029 

2,584 

2,626 

778 

1,220 

1,705 

2,437* 

15 

207 

342 

402 

21 

259 

259 

272 

108 

182 

343 

533 

473 

242 

53 

228 

39 

99 

139 

2981 

122 

231 

569 

704 

1,471 

5,648 

6,579 

7,817 

1,085 

4,714 

5,472 

6,848 

367 

846 

1,063 

929 

19 

88 

44 

40 

1,976 

3,848 

7,561 

10,082 

1,650 

2,308 

3,138 

4,787 

(3) 

935 

1,917 

2,986 

326 

605 

2,506 

2,309 

1  Turkey  in  Europe  is  included  in  Asia  in  1928. 

2  Includes  Chosen  beginning  1926. 

3  Included  in  "All  other." 

Source:  Bureau  of  Foreign  and  Domestic  Commerce,  Commerce  Year  Book,  1929,   Vol.  I. 
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Take,  as  an  example,  wages  in  a  town  for  which  a  sales  potential 
is  to  be  worked  out.     The  data  may  be  listed  as  follows: 

Table  VI. — Number  of  Workers  Receiving  Wages  as  Listed  Below 


Earnings  per  week  Number 
(in  dollars) 

10-14  35 

15-19  32 

20-24  40 

25-29  38 

30-34  30 

35-39  20 

Table  VII. — Number  of  Homes  Owned  Based  on  Value,  City  of  X 


Value  (in  dollars)  -  Number 


2,000-2,900 

40 

3,000-3,900 

43 

4,000-4,900 

35 

5,000-5,900 

20 

6,000-6,900 

10 

7 ,  000  and  over 

5 

3.  Orders  of  tabulation.  There  are  three  orders,  or  degrees  of 
development,  which  are  commonly  employed  and  beyond  which 
it  is  scarcely  feasible  to  go. 

The  first  order  involves  only  a  single  set  of  numbers  tabulated 
against  the  given  classes,  as: 

Table  VIII. — Population  of  United  States  by  Census  Years 


Census  year  Total  population 

1930  122,775,046 

1920  105,710,620 

1910  91,972,266 

1900  75,994,575 

The  second  order  involves  two  coordinate  parts,  tabulated 
against  the  given  classes,  as: 


328 


THE  TECHNIQUE  OF  MARKETING  RESEARCH 


Table  IX. — Total  White  and  Negro  Population  of  the  United  States 

by  Census  Years 


Census 

Total  population 

year 

White 

Negro 

1930 
1920 
1910 
1900 

108,864,207 
94,820,915 
81,731,957 
66,809,196 

11,891,143 

10,463,131 

9,827,763 

8,833,994 

1  Fifteenth  Census  of  the  United  States,  1930. 

The  third  order  involves  a  further  division  of  each  of  the 
coordinate  parts,  as : 

Table  X. — Population  of  United  States  by  Sex  and  Color  for  the 
Given  Census  Years 


Total  population 

Census 
year 

White 

Negro 

Male 

Female 

Male 

Female 

1930 
1920 
1910 
1900 

55,163,854 
48,430,655 
42,178,245 
34,201,735 

53,700,353 
46,390,260 
39,553,712 
32,607,461 

5,855,669 
5,209,436 
4,885,881 
4,386,547 

6,035,474 
5,253,695 
4,941,882 
4,447,447 

1  Fifteenth  Census  of  the  United  States,  1930. 

It  will  be  noted  that  in  these  tables  the  "  order  of  arrangement " 
has  been  reversed,  for  the  reason  that  the  latest  census  is  the  one 
most  usually  referred  to. 

It  is  clear,  also,  that  still  other  developments  are  possible  on 
the  subject  of  Population.  White  male  and  white  female  may 
be  divided  into  Married  and  Single,  for  instance,  and  each  of 
these  into  Age,  Occupation,  Complexion  or  other  groups.  These 
developments  would  make  the  table  too  involved,  however,  for 
effective  use.  That  is  the  reason  this  type  of  tabulation  is  rarely 
carried  beyond  the  third  order. 

4.  Labels.  Everything  necessary  to  be  known  as  to  the  purpose 
or  meaning  of  a  table  should  be  clearly  and  fully  set  forth.  This 
includes,  always,  a  precise  statement  of  subject  matter  and  just 
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what  it  represents;  the  units  of  measurement  used;  the  source  of 
the  data  and  when  they  were  taken. 

5.  Structural  Details.  Captions  naturally  should  be  more 
prominent  than  subcaptions.  Generally,  a  heavy  or  double 
ruling  is  placed  at  the  top  of  the  table  and  a  light  or  single  ruling 
at  the  bottom,  with  the  sides  of  the  table  left  open.  To  meet  the 
requirements  of  some  presentations,  a  reasonable  latitude  is  per- 
mitted with  regard  to  all  these  structural  ideas.  It  is  important 
to  get  the  data  set  up  in  tabular  form  with  precision  and  clarity. 

The  construction  of  the  other  graphic  forms  involves  a  tech- 
nology all  its  own.  It  would  be  utterly  impracticable,  therefore, 
to  attempt  here  any  comprehensive  treatment  of  the  subject.  In 
a  book  of  this  sort  we  can  only  touch  the  several  forms  lightly  in 
general  terms  and  commend  the  reader  to  a  careful  review  of 
some  of  the  standard  works  on  graphic  presentation.1  "Certainly, 
no  research  man  can  be  adequately  equipped  who  has  not  done 
considerable  studious  reading  on  this  important  subject.  The 
more  familiar  graphic  forms  are : 

the  graph.  The  distinguishing  mark  of  this  type  is  the  curve.. 
When  drawn  on  an  ordinary  coordinate  ground — both  the  hori- 
zontal and  vertical  rulings  being  equally  spaced — it  constitutes 
a  plain  graph.  When  drawn  on  a  geometric  ground — the  hori- 
zontal or  vertical  rulings,  or  both,  being  spaced  to  correspond 
with  the  logarithmic  scale— it  is  a  ratio  graph. 

The  plain  graph  is  often  used  to  portray  such  direct  ideas  as : 

Historical.  The  growth  of  a  business  or  the  fluctuations  in  the 
prices  of  a  commodity  over  a  period  of  years. 

Descriptive.  The  presence  of  some  condition  or  factor  in  a 
business. 

Comparative.  The  relation  between  two  or  more  ideas  or 
factors. 

Predictive.     The  trend  of  sales  or  costs  projected  into  the  future. 

There  are  several  variations  of  the  plain  graph  in  more  or  less 
common  use.  When,  for  instance,  a  graph  shows  two  curves 
representing  two  aspects  of  the  same  subject,  on  different  levels, 
the  area  between  the  curves  may  be  colored,  shaded  or  otherwise 
embellished  to  accentuate  the  difference.  This  is  sometimes 
called  a  "  Zone  Graph  "as  shown  in  Fig.  48  and  is  used  to  illustrate 

1  Special  bibliography  at  end  of  chapter  on  p.  344. 
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such  ideas  as  the  range  in  performance,  over  a  period  of  time, 
between  the  salesman  at  the  top  of  the  list  and  the  man  at  the 
bottom.  The  average  periodical  performance  of  the  sales  staff 
as  a  whole  might  also  be  shown  by  a  dotted  line  or  other  mark 
running  through  the  shaded  zone. 


Jan.  Feb.  Mar.  Apr.  May  June  July  Aug.  Seph  Och  Nov.  Dec 

Fig.  48. — Illustrating  a  zone  graph. 
16 


1914   1915    1916    1917    1918     1919    1920    1921     1922   1923    1924  1925  1926 
Fig.  49. — A  band  graph. 

In  another  variation  of  the  plain  graph  a  series  of  curves  are 
drawn,  each  representing  a  component  part  of  the  same  subject 
and  the  area  between  each  two  curves  is  so  shaded,  colored  or 
marked  as  to  differentiate  it  from  other  areas.  This  results  in  a 
series  of  wavering  stripes,  clearly  distinguishable  one  from  the 
other.  This  type  of  graph  is  called  a  band  graph.  An  example  of 
such  a  chart  is  shown  in  Fig.  49. 
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The  Cumulative  graph  is  another  variation  of  the  plain  graph 
This  is  just  what  its  name  implies;  it  is  a  graph  to  which  additions 
are  made  at  certain  fixed  intervals.  For  example:  If  a  compact 
and  visible  method  is  desired,  to  determine  at  the  end  of  any  week 
just  how  closely  sales  have  been  approximating  the  rate  of  pro- 
duction, a  graph  could  be  carried  showing  two  curves — one  for 
production  and  one  for  shipments.  If  the  rate  of  production  can 
be  predetermined,  or  held  at  some  steady  weekly  performance, 
the  production  curve  can  be  set  up  for  the  year  in  advance  and, 
then,  only  the  curve  of  shipments  would  need  to  be  thrown  in 
from  week  to  week  (Fig.  50). 
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9       16      23 
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2       9       16 
February 
Week     Ending 
Fig.  50. — Example  of  a  cumulative  graph. 
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Then,  there  is  the  frequency  graph.  This  is  a  means  of  pictori- 
alizing  the  frequency  series,  described  in  the  notes  on  statistical 
procedures  on  page  362.  Any  data  which  can  be  set  up  in  such  a 
series  can  be  set  up  also  as  a  graph  and,  generally  speaking,  any 
problem  in  marketing  in  which  the  determination  of  an  average 
is  important  is  susceptible  of  such  treatment.  "What  is  the 
average  size  order?"  "Which  of  several  products  predominates 
in  the  separate  orders?"  "In  what  territories  is  the  firm's 
advertising  productive?"  "What  is  the  average  cost  of  sales?" 
—all  such  questions  as  these  are  adaptable  to  a  frequency  series 
or  table  and,  for  demonstration  purposes,  may  be  shown  as  graphs. 

One  of  the  most  important  uses  for  the  plain  graph  is  to  com- 
pare two  or  more  curves  representing  different  ideas.     If  the 
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relation  between  such  ideas  be  merely  incidental,  the  result  is  a 
"comparison"  graph;  but  if  the  relation  be  one  of  dependency- 
showing  a  causal  effect  of  one  factor  upon  others— the  result  is 
a  "correlation"  graph.  These  groups  are  both  highly  useful  in 
marketing  work  and  should  be  studied  carefully,  as  to  purpose  and 
structure,  in  some  of  the  standard  works  on  graphic  presentation. 
The  ratio  graph  has  an  altogether  different  purpose.  It  is 
intended  to  show  changes— in  terms  of  "ratio."  It  is  the  rate 
of  change,  the  percentage,  that  is  shown  in  this  type  of  graph.  To 
illustrate:  Suppose  that  in  the  course  of  a  twelve-year  period  a 
certain  business  has  grown  in  sales  from  about  one  million  to 
more  than  three  million  dollars.  That  is  a  cumulative  or  com- 
pounded total  increase  of  about  two  hundred  per  cent  but,  of 
course,  the  year-to-year  increase  necessarily  varied.  Suppose, 
too,  that  the  business  has  two  major  divisions.  At  the  beginning 
of  the  period,  one  division  was  doing  about  $900,000  of  sales 
while  the  other  was  doing  only  about  $100,000.  Then  suppose 
the  business  progressed  in  this  manner : 


Year 

Division  A 

Division  B 

Total 

1923 

896,000 

106,000 

1,002,000 

1924 

1,072,000 

123,000 

1,095,000 

1925 

1,271,000 

147,000 

1,418,000 

1926 

1,441,000 

173,000 

1,614,000 

1927 

1,618,000 

191,000 

1,809,000 

1928 

1,794,000 

210,000 

2,004,000 

1929 

2,000,000 

233,000 

2,233,000 

1930 

2,204,000 

257,000 

2,461,000 

1931 

2,398,000 

281,000 

2,679,000 

1932 

2,599,000 

301,000 

2,900,000 

1933 

2,759,000 

310,000 

3,069,000 

1934 

2,955,000 

355,000 

3,310,000 

If  these  data  were  set  up  as  a  plain  graph — as  shown  in  Fig.  51,  it 
would  appear  that  Division  A  ran  steadily  away  from  Division  B. 
The  curve  representing  the  latter  would  drag  along  the  bottom 
of  the  graph  and  one  would  wonder  if  such  a  lagging  enterprise 
were  worth  while. 

When  the  same  data  are  set  up  as  a  "ratio"  graph,  however, 
Division  B  shows  a  true  progress  substantially  paralleling  that 
of  Division  A.     In  Fig.  52,  the  smaller  division  takes  on  the 
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aspect  of  a  promising  business  and,  if  its  contribution  to  the  com- 
pany's profit  should  be  commensurate,  no  one  would  question 
its  value — regardless  of  its  showing  on  the  " plain"  graph. 

Wherever  the  rate  of  change  in  any  situation,  up  or  down,  has 
any  important  bearing  on  the  problem,  both  plain  and  ratio 
graphs  should  be  included  in  the  presentation,  so  that  the  client 
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Fig.  51. — Showing  one  division  of  a  business  rapidly  running  ahead  of  the  other. 


or  other  reader  will  have  the  advantage  of  the  comparative  view 
(see  Figs.  51  and  52).  Of  course,  the  rate  of  change  can  also 
be  shown  on  a  simple  coordinate  form  by  computing  the  increase 
or  decrease  of  each  fluctuation  and  setting  up  the  result  as  a 
percentage  of  the  first  figure  in  the  series.  This  picture,  as 
presented  in  Fig.  53,  shows  nothing  more  than  that  the  two 
departments  are  running  about  parallel  as  to  volume  of  sales. 
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the  chart.  The  distinction  between  the  graph  and  the  chart 
is  not  very  well  denned.  For  popular  use  in  marketing,  it  would 
seem  rational  to  regard  the  meaning  of  the  word  " graph"  as 
limited  to  a  presentation  of  line  curves — unadorned,  as  in  the 
several  examples  referred  to  in  the  preceding  paragraph;  and 
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Fig.  52. — Same  data  as  preceding  graph-.     Shows  the  two  divisions  to  be  pro- 
gressing at  about  the  same  uniform  rate. 


the  word  "chart"  as  a  picture  of  an  idea  or  situation  expressed 
in  symbols — fashioned  of  significant  designs,  devices  or  maps. 
This  definition  includes  the  familiar  bar  or  column  chart,  the 
circle  chart,  the  map  chart  and  the  many  ingenious  presentations 
which  fall  within  the  category  of  pictorial  charts. 

■The  Bar  Chart.     This  is  one  of  the  most  widely  used  forms.     It 
is  perhaps  not  quite  so  clear  and  positive  a  method  as  the  line 
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graph  but  is  susceptible  of  more  striking  and  compelling  effects 
in  design,  color  and  decoration.  A  glance  through  some  of  the 
standard  textbooks  on  the  subject  should  prove  interesting  to 
any  one  concerned  with  this  type  of  presentation. 

As  a  rule,  bar  charts  are  drawn  on  unsealed  and  unruled  paper 
but  in  every  case  they  must  be  calibrated,  annotated  and  labeled 
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Fig.  53.— Same  data  as  preceding  graphs.     Shows  the  parallel  progress  of  the 
two  divisions  but  conceals  the  disparity  in  volume. 

in  such  a  manner  as  to  leave  no  doubt  as  to  the  significance  of 
any  detail. 

There  are  several  variations  of  the  bar  chart.  The  single  bar, 
representing  a  single  fact  or  idea,  customarily  appears  in  series 
showing  the  relationship  of  several  single  but  comparable  facts 
or  ideas.     The  bars  may  be  placed  either  vertically,  as  columns, 
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or  horizontally,  as  bars — both  methods  being  shown  in  Figs.  54 
and  55. 

This  is  a  very  simple  chart  form.     It  is  easily  constructed 
directly  from  the  data,  entails  no  mathematics — except  that  the 
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Fig.  54. — Vertical  bar  chart. 
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Fig.  55. — Horizontal  bar  chart. 


bars,  to  be  comparable,  must  be  drawn  to  the  same  scale — and 
its  significance  is  immediately  manifest.  It  is  flexible  enough  to 
be  used  in  almost  any  conceivable  marketing  situation. 

Sometimes,  one  or  more  single  bars  are  set  up  to  represent  a 
series  of  facts  or  ideas,  each  being  separable  into  parts  or  elements. 
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Hemp 


These  are  " component"  bars.  This  form  is  useful  where  it  is 
necessary  to  compare  not  only  the  bars  themselves  but  also 
their  several  parts.  The  bars  in  such  charts  may  be  of  vary- 
ing lengths,  as  shown  in  Fig.  56  or  they  may  be  of  equal  length 
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as  in  Fig.  57.     Which  of  these  types  to  use  in  any  given  case  is 
governed  by  the  subject  matter  and  the  purpose  of  the  chart. 

Circumstances  sometimes  arise  in  marketing  which  require  the 
presentation  of  several  series  of  comparable  reflections  on  one 
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Fig.  57. — Component  bars  showing  data  as  per  cents  of  total. 


chart.  Suppose,  for  example,  that  in  rehabilitating  a  chain-store 
system,  as  a  marketing  enterprise,  it  became  necessary  to  know 
with  some  exactitude  how  its  scale  of  wages  to  store  clerks  com- 
pared with  that  current  in  competitive  stores.  The  research 
agency  would  take  data  from,  let  us  say,  corporate  and  voluntary 
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Fig.  58. — A  multiple-bar  chart. 


chains  and  from  independent  stores  in  the  grocery,  drug  and 
restaurant  fields— to  determine  the  minimum,  maximum  and 
average  wages  for  clerks  in  each  type  of  store  and  in  each  field. 
The  data,  when  assembled,  could  be  set  up  for  presentation  in 
multiple-bar  charts  as  shown  in  Fig.  58. 


338 


THE  TECHNIQUE  OF  MARKETING  RESEARCH 


The  Circle  Chart.  These  are  the  commonly  known  pie  charts. 
They  are  used  frequently  to  show  the  composition  of  some  single 
factor.  The  idea  probably  originated  in  an  effort  to  show  how 
the  consumer  spent  the  old  American  dollar — the  big  round  silver 
one.     This  is  a  simple  and  interesting  form;  it  is  comparatively 

50 


Fig.  59. — Elements  of  sales  cost  presented  as  per  cents  of  the  circumference  of  a 

circle. 

easy  to  construct  with  the  aid  of  a  protractor,1  but  it  is  subject  to 
some  uncertainty.  The  eye  cannot  easily  measure  the  length 
of  the  various  arcs,  the  areas  of  the  different  sectors  or  the  angles 
at  the  centre.  And,  to  compare  two  or  more  such  circles  of  vary- 
ing sizes  is  almost  impossible,  even  when  shown  side  by  side. 

1  The  protractor  is  simply  a  semicircle  of  metal  or  composition,  scaled  to  per 
cents  or  to  degrees  of  a  circle — the  outer  edge  representing  50  per  cent  or  180 
degrees.  To  set  off  segments  of  given  sizes,  when  the  protractor  is 
scaled  to  per  cents,  is  a  direct  operation;  when  per  cents  are  to  be  measured  on 
a  "degree"  scale,  it  is  necessary  only  to  compute  each  segment  on  the  basis 
of  1  per  cent  =3.6  degrees.  Twenty-five  per  cent  would,  therefore,  repre- 
sent 90  degrees  or  one  quarter  of  the  circle  or  "pie."  A  still  simpler  way 
would  be  to  use  "circular  percentage"  chart  paper — on  which  the  center  is 
marked  and  the  circumference  set  off  in  units  of  1  per  cent.  Keuffel  & 
Esser  Company  and,  perhaps,  other  manufacturers  have  these  forms  in  stock. 
This  form  was  used  in  preparing  Fig.  59. 
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When  the  circle  form  is  employed,  however,  the  value  of  each 
sector  must  be  clearly  marked  in  some  manner  as  in  Fig.  59. 
The  Map  Chart.  This  form  is  employed  usually  to  demon- 
strate some  geographical  condition  or  circumstance.  The  subject 
matter  is  usually  population,  number  or  location  of  customers  or 
prospects,  sales  volume  or  cost,  advertising  cost  or  results,  own 
or  competitors'  coverage — considered  as  to  district,  state,  county 
or  city.  Sometimes  a  detail  map  of  a  large  market  like  the  New 
York  or  Chicago  metropolitan  area  is  set  up  as  a  chart  to  show 


Fig. 


60 —Map   chart  contrasting  the  accessibility  of  consumers    (population) 
in  the  New  York  metropolitan  area  with  the  diffusion  in  the  West. 

the  residential  or  other  areas  being  canvassed  or  to  be  attacked 
with  special  sales  work,  sampling  or  advertising. 

This  is  a  very  useful  form  of  chart,  too,  where  spatial  ideas 
are  to  be  portrayed.  A  manufacturer  might  regard  the  New 
York  metropolitan  market  as  too  costly  to  open  or  as  being  not 
worth  the  effort.  But  if  he  saw  the  consuming  capacity  of  the 
New  York  market,  as  represented  by  population,  superimposed 
on  some  part  of  the  far  or  middle  West  and  covering  from  twelve 
to  fifteen  large  states,  the  opportunity  might  take  on  a  different 
aspect.  In  the  light  of  such  a  presentation  as  is  shown  in  Fig.  60, 
the  manufacturer  might  at  least  give  the  matter  more  thought, 
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and  get  together  more  data  on  cost  and  methods,  before  he 
decided  definitely  against  a  New  York  campaign. 

In  marketing  work  there  are  several  other  types  of  charts 
suitable  for  special  purposes :  the  functional  chart — designed,  for 
instance,  to  show  how  the  organization  works  and  to  point  out 
the  general  current  of  authority;  the  organization  chart — a  static 
presentation  of  the  relationships  which  exist  among  the  various 
departments;  and  the  planning  chart — designed  to  lay  the  course 
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Fig.  61. — The  chart  and  photographs — prepared  by  the  Rural  Electrification 
Administration — show  the  need  for,  and  some  uses  of,  electricity.  (The  New 
York  Times,  May  31,  1936.) 


and  to  integrate  the  steps  of  some  special  marketing  effort.  All 
of  these  charts  are  drawn  usually  in  the  familiar  "block-and- 
line"  form. 

The  Pictorial  Chart.  There  is  practically  no  limit  to  the  vari- 
ety possible  with  this  type  of  chart.  It  is  arresting  to  the  eye 
and  generally  holds  the  attention,  at  least,  superficially.  Actu- 
ally, however,  this  is  one  of  the  least  exact  and  the  least  reliable 
of  all  the  methods  of  graphic  presentation.  Probably  its  use 
should  be  limited  to  those  presentations  which  are  intended  only 
for  popular  and  casual  consumption. 

The  greatest  weakness  of  this  type  of  chart  is  that  so  often 
the  reader  has  no  means  of  knowing  on  what  basis  he  is  to  con- 
strue the  picture — its  height,  width,  area  or  volume.     Even  if 
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he  knows,  it  is  practically  impossible  to  comprehend  a  comparison 
between  any  two  pictures — a  large  figure  and  a  small  one — by 
visual  means  alone.  This  difficulty  defeats  the  fundamental 
purpose  of  a  chart  which  is  to  make  comprehension  complete, 
immediate  and  easy. 

If,  for  any  reason,  pictures  must  be  used,  it  is  better  to  show 
figures  in  rows — each  figure  representing  some  designated  number 
of  units.  For  example:  If  the  sale  of  refrigerators  in  1935  were 
seven  times  as  large  as  in  1920,  the  improvement  could  be  shown 
by  a  row  of  seven  little  refrigerators — with  1920's  sales  repre- 
sented by  one  reproduction  of  like  size.  Or,  in  a  comparison  of 
military  forces,  the  United  States  army  might  be  represented  by 
one  soldier  while  the  ten  times  greater  army  of  France,  for 
instance,  might  be  represented  by  a  row  of  ten  such  soldiers. 
There  can  be  no  mistake  about  the  meaning'  of  such  a  picture. 
But,  in  all  cases,  the  actual  figures  or  percentages  or  measurements 
should  be  shown  somewhere  on  the  picture.  Figures  61  and  62 
show  this  form  of  chart  admirably. 

Final  Review 

This  is  a  dress  rehearsal.  In  a  large  or  hurried  study  every 
member  of  the  staff  has  been  working  at  top  speed  and  now  the 
job,  technically,  is  finished.  Tomorrow,  or  soon  after,  it  is  to  be 
submitted  to  the  client  and  the  report  maker  must  know  that  it 
is  as  near  to  perfection  as  his  opportunities  and  his  capacities  can 
make  it.  So,  alone,  or  in  conference  with  other  qualified  persons, 
he  gives  the  finished  work  one  last  review. 

From  checks  and  tests  applied  to  the  study  at  various  stages 
one  can  now  feel  fairly  sure  of  its  fullness,  accuracy  and  integrity. 
At  this  juncture,  therefore,  there  should  be  only  two  points  to  be 
reviewed  critically.     These  should  concern  only  the  presentation. 

For  Technical  Errors.  This  is  a  final  scrutiny  of  the  technical 
features  of  the  presentation.  It  calls  for  no  extended  explana- 
tion. Its  obvious  purpose  is  to  find  and  correct  any  mistakes 
that  may  lie  hidden  in  the  report. 

text.  As  a  literary  work  the  report  must  be  examined  care- 
fully with  respect  to  the  following  points :  It  must  be  grammatical, 
adequate,  clear,  pertinent  and  convincing;  the  spelling,  capitaliz- 
ing and  punctuation  must  be  correct;  and  whether  the  report 
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is  typed  or  printed,  the  text  must  be  attractively  set  up  on  the 
pages  and  in  symmetrical  relation  to  all  the  tables  and  charts. 
At  this  juncture  it  is  well  to  remember  that  while  literary  style 
is  commendable  and  in  some  situations  highly  effective,  a  report 
is,  above  all,  a  business  paper.  It  presents  no  opportunity  for 
circumlocutions  or  for  palpably  fancy  writing  and  it  should  be 
made  as  crisp  and  as  concise  in  text  as  possible. 

THE  FIELD   OF  SOCIAL   SECURITY 
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Fig.  62. — (The  New  York  Times,  July  5,  1935.) 

calculations.  All  figures  must  be  checked.  This  does  not 
mean,  of  course,  that  all  the  calculations  have  to  be  gone  over 
again;  that  sort  of  checking  should  be  done  while  the  work  pro- 
ceeds. The  point  here  is  to  see  that  no  errors  in  the  figures,  per- 
centages, symbols,  totals  or  arrangement  have  occurred  during 
transcription. 

This  final  review  might  also  include  such  questions  as:  Do  the 
calculations  presented  in  the  report  demonstrate  the  most  com- 
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pelling  points  revealed  by  the  study?  Have  all  the  more  sig- 
nificant points,  which  are  susceptible  to  such  demonstration,  been 
so  presented?  Are  there  sufficient  figures  and  tables  to  support 
the  conclusions?  Have  they  been  set  forth  in  the  most  logical 
and  convincing  sequence?     Etc.,  Etc. 

illustrations.  All  the  graphs  and  charts  should  be  checked 
to  see  that  they  are  in  their  proper  places;  that  their  labels  and 
legends  are  adequate  and  clear;  that  they  are  completely  self- 
explanatory;  and  that  they  require  no  further  embellishments  of 
any  kind. 

One  of  the  most  important  features  to  be  examined  at  this 
point  is  whether  or  not  the  data  selected  for  illustrations  are 
actually  those  most  likely  to  effectuate  the  expressed  purpose  of 
the  study. 

format.  This  point  suggests  a  critical  review  of  the  form, 
size,  shape,  color,  type  face,  binding,  decoration  and  other  such 
physical  features  of  the  report — to  see  that  in  all  these  particulars 
the  finished  report  follows  the  specifications  previously  decided 
upon  and  to  make  any  last-minute  adjustments  or  improvements 
that  might  seem  advisable. 

From  the  technical  point  of  view,  this  last  scrutiny  is  no  more 
than  a  natural  and  prudent  precaution  against  any  prejudicial  effect 
of  haste  or  carelessness.  If  the  work  has  been  thoughtfully  and 
diligently  prepared,  there  should  be  little  to  correct  at  this  stage. 

In  the  beginning  the  study  was  invested  with  a  mission.  The 
purpose  of  this  final  review,  in  general  terms,  is  to  determine  in 
advance  how  well  the  report  is  likely  to  fulfill  that  mission;  to 
strengthen  its  weaknesses,  if  possible;  to  accentuate  its  cogent 
points  and  to  prepare  such  collateral  comments  and  arguments 
as  may  assist  in  the  actual  presentation  of  the  report. 

For  Editorial  Defects.  There  are  in  addition  a  few  functional 
features  associated  with  the  editorial  phase  of  the  report  to  which 
some  of  this  last-minute  attention  might  be  directed.  They 
are  the  questions  of 

subject  matter.  Is  all  the  really  effective  material  included? 
It  should  be,  of  course,  but  is  it?  It  has  been  very  often  said 
that  "the  report  has  a  sale  to  make."  At  this  point  we  should 
make  sure  that  all  the  ammunition  is  at  hand  ready  for  the 
attack;  that  nothing  has  been  overlooked  that  might  help  the 
report  to  achieve  its  objective. 
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treatment.  We  must  make  sure  that  the  material  has  been 
properly  prepared;  that  the  comments  and  observations  through- 
out the  work  are  appropriate,  clear  and  forceful;  that  the  reason- 
ing is  sound,  the  arguments  logical  and  effectively  presented;  and 
that  the  conclusions  are  not  just  theoretically  feasible,  but  thor- 
oughly practical. 

arrangement.  The  question  with  respect  to  this  feature  is 
whether  or  not  the  effect  of  the  report  can  be  improved  by  any 
change  in  the  sequence  in  which  the  material  is  placed.  Are  the 
data,  illustrations,  notes,  comments,  arguments,  conclusions- 
all  so  laid  out  as  to  assure  to  the  report  the  maximum  chance  of 
accomplishing  its  ultimate  purpose? 

As  with  the  technical  features  of  the  report,  it  is  to  be  presumed 
that  at  this  late  moment  the  editorial  function  will  have  been 
fully  and  competently  performed.  This  final  review  is  to  make 
sure  of  that  fact  and,  so  far  as  may  be  possible,  to  rectify  in  time 
any  deficiencies  that  may  be  found.  The  report  simply  must 
fulfill  its  purpose.     No  safeguard  to  that  end  can  be  overlooked. 
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CHAPTER  XVIII 
EXTENSION  OF  RESEARCH  SERVICE 

(As  Presented  in  Chart  J) 

The  presentation  of  a  final  report  does  not  always  terminate  a 
study.  It  would,  if  marketing  research  were  merely  a  commodity 
— like  a  Cook's  tour;  but  it  is  much  more  than  that.  Marketing 
research  is  distinctly  a  professional  activity.  Its  roots  are  sunk 
deep  in  the  scientific  soil  of  mathematics,  psychology,  economics 
and  sociology.  Its  approach,  its  procedures,  its  instrumentalities 
and  its  purposes  are  all  essentially  scientific  in  character.  The 
practitioner  must,  therefore,  be  imbued  with  the  spirit  and  the 
zeal  of  the  scientist.  His  interest  must  follow  his  work — until 
its  integrity  has  been  demonstrated  and  its  ultimate  objective 
attained. 

Application 

The  position  of  the  marketing  research  man  is  like  that  of  the 
engineer.  An  engineer  who  has  designed  and  built  a  bridge 
cannot  dust  off  his  hands  and  roll  down  his  sleeves  the  moment 
his  bridge  is  ready  for  traffic.  His  job  is  not  yet  finished.  Inher- 
ent in  the  very  nature  of  his  work  are  professional  responsibilities 
which  extend  to  the  behavior  and  service  of  that  bridge  in  use. 
Analogous  responsibilities  rest  also  on  the  practitioner  of  market- 
ing research.  ~ 

After  having  presented  his  report,  therefore,  and  after  its 
acceptance  by  the  client,  the  first  duty  of  the  research  man  is  to 
exert  all  the  pressure  he  logically  can  to  put  the  results  of  his 
study  to  work  in  his  client's  business.  In  some  cases  this  is  a 
comparatively  simple  operation.  To  give  effect  to  a  copy-testing 
study,  for  example,  it  is  necessary  only  to  extend  over  a  broad 
field  the  "copy"  shown  to  have  been  most  productive  in  the 
narrower  field  of  the  test.  To  make  a  study  of  newspaper  or 
magazine  circulation  effective,  it  is  necessary  only  to  set  the  data 
up  in  such  form  as  will  help  the  publisher  overcome  some 
deficiency  or  sell  more  space. 

347 
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In  the  study  of  milk  consumption  referred  to  on  page  274, 
''Application"  followed  promptly  the  convincing  evidence  that 
growing  boys  regard  milk  drinking  as  a  " sissy"  practice.  As 
recounted  in  the  footnote  on  that  page  the  application  took  the 
form  of  a  series  of  radio  discussions  by  a  husky  and  popular  foot- 
ball coach,  who  revived  the  juvenile  male  interest  in  milk  by 
recommending  it  as  the  real  " he-man's"  food. 

In  such  cases  application  flows  naturally  and  easily  from  a 
convincing  report.  The  real  difficulties  are  encountered  in  con- 
nection with  situations  which  require  such  radical  action  as  the 
removal  of  retarding  factors,  the  correction  of  traditional  weak- 
nesses, the  adoption  of  new  methods  or  the  introduction  of  drastic 
retrenchments.  Unfortunately,  business  has  its  share  of  stupid, 
lazy,  willful  and  venal  persons — each,  unwittingly  or  otherwise, 
an  obstructionist  or  a  saboteur.  Production  research  encountered 
plenty  of  this  opposition  in  its  day.  If,  however,  distribution  is 
to  be  correspondingly  improved,  the  influences  of  such  people 
must  be  overcome,  if  at  all  possible.  And,  since  it  is  the  research 
man  who  best  understands  the  purpose,  the  process  and  the 
utility  of  his  work,  it  is  he  who  should,  to  the  limit  of  his  ability, 
strive  to  make  the  study  effective  in  action. 

To  Insure  Full  Understanding  of  the  Research.  This  is,  of 
course,  the  first  and  most  obvious  step  toward  putting  the  results 
to  work.  If  the  client  is  to  take  any  action  at  all,  he  must  thor- 
oughly understand  the  study  in  all  of  its  implications.  The 
purpose  of  the  final  report,  in  whatever  manner  it  may  have  been 
presented,  was  to  give  the  client  just  such  an  understanding. 
But,  the  presentation  is  not  always  enough ;  it  cannot  anticipate 
the  precise  points  each  of  several  interested  persons  will  fail  to 
comprehend  nor  can  it  provide  in  advance  against  the  further 
questions  which  inevitably  arise  during  the  client's  study  of  the 
report. 

As  a  rule,  therefore,  it  is  necessary  for  the  research  man  to 
" stand  by"  until  the  client  and  every  interested  member  of  his 
staff  is  clearly  and  fully  informed  on  every  angle  of  the  study  and 
on  the  significance  and  soundness  of  all  its  conclusions.  He 
should  utilize  his  disinterested  position  and  his  special  knowledge 
of  the  situation,  forcefully  to  impress  upon  the  client  the  benefit 
likely  to  follow  the  proper  use  of  the  study  and  of  the  injury  to 
the  business  which  might  possibly  ensue  from  its  neglect. 
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To  Stress  the  Time  Factor  in  the  Use  of  Findings.  Even  with 
a  clear  understanding  of  the  study,  a  variety  of  circumstances 
may  intervene  to  delay  action.  Many  studies  involve  several 
departments  or  several  executives  within  the  client's  business. 
In  such  cases,  they  should  all  go  over  the  report  and  usually  this 
consumes  considerable  time.  Then,  too,  there  are  the  chronic 
procrastinators  and  reactionaries  in  the  group  who  just  cannot 
bring  themselves  to  do  anything  decisive  about  the  report  anyway. 
As  a  consequence  of  such  circumstances,  the  action  demanded  by 
the  situation  is  frequently  pushed  further  and  further  off. 

When  necessary,  the  research  man  should,  to  the  limit  of  his 
influence,  make  clear  the  value  of  time.  Every  marketing  situation 
is  in  a  state  of  flux.  Public  tastes,  fashions,  habits  and  prefer- 
ences change;  competitive  conditions,  as  represented  by  the  sales 
and  advertising  pressure  of  new  and  old  rivals,  also  change;  in  a 
subtle — sometimes  imperceptible — way  even  one's  own  organiza- 
tion changes.  These  and  other  important  factors,  both  internal 
and  external,  are  shifting  all  the  time  "for  better  or  for  worse.'' 
Even  before  its  completion,  therefore,  a  study  of  a  business  is 
already  undergoing  a  progressive  process  of  obsolescence.  In  a 
week — or  a  month — or  in  three  months,  it  may  be  utterly  worthless. 

The  day  a  research  report  is  presented — if  the  recommendations 
can  be  checked  and  approved  so  quickly — is  the  very  best  of  all 
days  to  start  action.  The  research  man  should  do  his  part  to 
make  it  so. 

To  Sustain  Interest  in  the  Use  and  Outcome  of  the  Study. 
It  is  not  sufficient  merely  to  begin  the  application  of  research 
results.  Their  use  must  be  pushed  through  to  an  effective  conclu- 
sion. A  great  many  marketing  situations  require  a  protracted 
program.  A  study  may  call  for  a  series  of  actions,  or,  perhaps,  a 
succession  of  experiments  with  new  pplicies,  new  products,  new 
markets  or  new  methods.  Not  alone  should  the  research  man 
sustain  his  own  interest  in  the  application  of  the  study  in  such 
cases,  but  he  has  also  some  responsibility  to  keep  active  the 
interest  of  his  client  and  his  organization. 

Correcting  wasteful  marketing  habits  or  adopting  new  attitudes 
in  marketing  is  like  breaking  oneself  of  smoking  or  like  forcing 
virtue  into  some  snug  corner  of  the  soul  to  displace  a  stubborn 
and  cherished  personal  vanity.  It  takes  fortitude,  determination, 
persistence— to  "shake  off  the  old  man  and  put  on  the  new." 
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If,  therefore,  in  response  to  the  presentation  and  added  elabora- 
tions, the  client  once  embarks  upon  a  planned  course  of  action, 
the  research  man  should  do  his  part  toward  holding  the  client 
steadily  to  the  course. 

For  example,  a  study  designed  to  rehabilitate  a  certain  food- 
specialty  business  resulted  in  a  clearly  denned  marketing  program. 
This  program  consisted  of  seven  steps  which  were  referred  to  in 
the  report  as  " essentials."  Each  of  these  steps  was  aimed  at  a 
specific  and  proven  weakness  and  they  were  all  integrated  into 
one  complete  marketing  plan.  These  steps,  therefore,  had  to  be 
taken  in  the  order  of  presentation  and  none  of  them  could  be 
omitted  without  nullifying  them  all. 

Several  of  these  " essentials"  immediately  impressed  the  presi- 
dent of  the  company.  These  steps  he  was  inclined  to  push 
through  to  the  limit.  They  appealed  to  him  personally;  but  it 
was  only  by  dint  of  constant  pressure  from  others  in  the  organiza- 
tion—actively supported  by  the  research  man  who  had.  exposed 
the  weaknesses  and  prescribed  the  correctives — that  the  program 
was  finally  carried  through  in  its  entirety  to  a  successful  and 
profitable  development.  There  were  a  dozen  emergencies  in 
which  parts  of  the  plan  would  have  been  scrapped  and  the  whole 
program  destroyed,  had  the  pressure  for  performance  not  been 
applied  at  those  crucial  moments. 

Emendation 

In  applying  the  results  of  a  study,  it  sometimes  happens  that 
previously  hidden  lapses  will  be  disclosed  which  require  some 
further  data.  These  lapses  are  not  just  ordinary  omissions  in 
the  original  study.  Nor  are  they  indicative  of  careless  or  incom- 
petent research.  They  arise  most  frequently  from  the  difference 
in  point  of  view,  approach  or  interest  between  the  businessman 
who  is  to  apply  the  findings  and  the  research  man  who  formulated 
them. 

Situations  of  this  sort  are  encountered  usually  in  those  more 
complicated  cases  in  which  the  findings  suggest  a  course  of  action 
in  conflict  with  the  client's  disposition  or  with  his  current  and 
established  practices. 

.  It  is  part  of  the  responsibility  of  the  research  man  to  assist  as 
far  as  he  legitimately  can  in  reconciling  these  differences  and  in 
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making  such  proper  adjustments  and  amendments  to  his  work  as 
will  assure  and  facilitate  its  application  in  the  client's  business. 
.  This  idea  holds  no  suggestion  of  altering  or  distorting  factual 
findings.  No  such  license  is  ever  legitimate  or  proper.  Where, 
however,  certain  specific  details  or  conclusions  are  made  the 
subject  of  controversy  and  there  becomes  apparent  an  inclination 
on  the  part  of  the  client  or  his  organization  to  disregard  such 
portions  of  the  study— to  the  possible  detriment  of  the  whole 
project — that  challenge  must  be  accepted. 

In  such  situations,  a  search  should  be  instituted  for  new  data 
bearing  specifically  upon  the  controverted  points,  in  order  to 
clear  the  client's  mind  of  doubt  or  to  throw  such  new  light  on  the 
original  data  as  will  satisfy  the  research  man  in  altering  his  own 
convictions.  The  principle  is  that  no  disputed  point  that  might 
adversely  affect  the  successful  application  of  the  study  should  be 
allowed  to  remain  unsettled.  A  reasoning  client  should  see 
the  necessity  for  this  as  well  and  as  quickly  as  the  research  man, 
and  he  should  readily  cooperate. 

To  Prove  the  Practicality  of  the  Findings.  It  is  to  be  assumed, 
of  course,  that  throughout  the  study  the  research  man  has  kept 
constantly  before  him  the  need  for  making  his  recommendations 
practical.  If,  therefore,  he  has  the  necessary  experience  and 
capabilities,  any  positive  course  of  action  he  prescribes  in  his 
report  should  be  workable — if  sincerely  and  competently  executed 
by  the  client  and  his  organization.  When  the  experienced 
research  man  is  not  absolutely  sure  of  the  effect  of  his  recom- 
mendations, he  should  present  them  only  as  suggestions  for  trial. 

In  either  case,  the  difficulty,  when  it  arises,  comes  usually  from 
the  "can't-be-doners."  The  business  woods  are  full  of  them — 
perched  high  up  in  the  trees — out  of  reach.  To  them  nothing  is 
"practical"  that  they  prefer  not  to  try;  it  is  the  cabalistic  formula 
by  which  the  defeatist  disposes  quickly  and  finally  of  all  action 
that  might  disturb  his  exalted,  secure  and  felicitous  position. 

The  point  is  that  whenever  the  charge  of  impracticality  is 
brought  against  a  study  the  research  man  should,  as  a  matter  of 
professional  pride,  endeavor  to  identify  the  precise  point  on  which 
the  charge  rests;  and  then,  if  the  opposition- is  not  too  obdurate, 
he  should  assemble  such  additional  data  and  collateral  evidence 
as  may  be  obtainable,  to  controvert  it — or,  if  so  be,  to  confirm 
the  charge.     Under  no  circumstances  should  he  accept  the  stigma 
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of  having  made  impractical  recommendations,  if  he  can  by  any 
honest  means  prove  the  contrary  and  bring  his  work  into  active 
use.     It  is  sometimes  made  impossible,  but  it  should  always  be 

tried. 

To  Fill  Out  Any  Uncompleted  Parts.  However  carefully 
planned  and  executed  marketing  research  may  be,  it  is  not 
remarkable  that  occasionally  a  client,  in  putting  the  results  into 
effect,  should  find  some  additional  data  necessary.  This  would 
refer  to  data  the  need  for  which  could  not  have  been  foreseen  in 
planning  the  research. 

For  example:  In  a  study  of  newspaper  circulation  in  a  certain 
city,  Newspaper  X  was  shown  definitely  to  predominate  in  four 
of  the  six  income  groups.  In  preparing  its  prospectus,  or  Pre- 
sentation, for  the  use  of  its  representatives,  its  national  advertis- 
ing manager  found  that  something  more  was  needed. 

By  a  narrow  margin,  a  rival  paper,  Newspaper  7,  was  shown  to 
be  the  leader  in  the  highest-income  level.  And  Newspaper  Y  was 
exploiting  that  circumstance  with  great  vigor— on  the  theory  that 
the  wealthy  class  represented  the  backbone  of  the  buying  power 
in  that  market.  This  idea  was  made  to  sound  very  logical  and 
convincing. 

The  other  income  level,  in  which  another  paper  held  leadership, 
was  the  very  lowest.  The  four  levels  dominated  by  Newspaper  X 
were  those  which  fell  between  the  highest  and  the  lowest.  It 
became  necessary,  therefore,  to  devise  some  means  by  which  the 
value  of  dominance  in  the  several  classes  of  income  could  be  shown 
with  some  authority. 

The  research  agency  had  been  commissioned  to  determine  the 
relative  positions  of  the  several  papers.  But  no  provision  had 
been  made  for  such  a  distinction  as  now  seemed  to  be  required. 
The  need  had  been  totally  unexpected.  Now,  however,  the 
picture  had  to  be  completed  by  procuring  some  additional  data 
that  would  enable  space  buyers  to  estimate  the  relative  values  of 
the  several  papers  as  advertising  media  from  the  point  of  view  of 
the  spending  income  of  their  respective  readers. 

Since  there  must  be  some  correlation  between  buying  power- 
as  it  may  be  assumed  from  median  incomes  within  the  several 
levels,  and  retail  sales— as  shown  by  the  census  of  distribution,  a 
study  was  made  of  these  two  factors.  Based  on  additional  data 
as  to  the  percentage  of  income  generally  allotted  by  persons  in 
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the  various  income  groups  to  such  items  as  are  included  in  "retail 
sales,"  a  computation  showed  that  the  two  groups  in  which  the 
other  papers  dominated,  while  embracing  22  per  cent  of  the 
population,  accounted  for  only  12  per  cent  of  the  retail  sales;  while 
the  four  middle  groups  dominated  by  Newspaper  X  accounted 
for  88  per  cent  of  all  the  retail  sales  of  that  market — the  real 
spending  power. 

This  made  an  effective  answer  to  the  publication  building  its 
sales  story  on  the  narrow  preference  of  just  the  highest-income 
group,  in  which  Newspaper  X  also  shared  substantially. 

To  Confirm  Accuracy.  It  sometimes  happens  that  in  endeavor- 
ing to  apply  a  study  the  client  or  his  organization  will  develop 
some  doubt  as  to  the  correctness  of  the  data.  Somewhere  they 
" strike  a  snag"  and,  instead  of  finding  a  way  around  it,  question 
the  facts.     That  is  so  much  the  easier  course. 

The  first  concern  of  the  research  man  should  be  as  to  the  fidelity 
of  his  own  work.  Of  this,  of  course,  he  should  be  definitely  sure 
at  this  stage.  He  should  know  that  the  research  process,  which 
he  set  in  motion  and  tested  in  various  ways  and  at  many  points, 
could  produce  nothing  less  than  a  thoroughly  accurate  reflection 
of  the  situation  as  it  actually  exists. 

Further,  one  of  the  research  man's  responsibilities  in  presenting 
his  report  was  to  give  his  client  a  clear  understanding  of  the  data 
in  all  of  its  implications.  He  must  have  been  prepared  to  do 
that;  and,  since  presumably  his  report  was  accepted,  he  must  have 
succeeded.  After  that,  any  question  of  accuracy  that  might  arise 
would  necessarily  have  to  do  with  the  exigencies  of  putting  the 
results  to  work.  Of  course,  the  research  man  must  hold  himself 
ready  to  correct  errors  in  his  reports,  even  if  these  errors  do  not 
develop  until  application  is  attempted. 

But,  if  the  original  research  work  has  been  sincere  and  com- 
petent, it  is  difficult  to  see  how  " doubts"  could  be  relieved  by 
any  additional  quantities  of  the  kind  of  data  already  under  ques- 
tion. Should  the  contrary  seem  at  all  likely,  however,  the 
research  man  should  at  once  undertake  the  collection  of  more 

data. 

As  a  rule,  such  situations  require  not  more  data  but  service  of 
another  kind.  This  service  is  not  related  to  research,  except  as 
a  means  of  bringing  its  results  into  fruition;  it  is,  rather,  a  func- 
tion of  marketing  itself. 
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Suppose,  for  instance,  a  study  of  a  local  market  should  show 
that  the  richest,  most  appropriate  and  most  promising  territory 
for  the  client's  product  was  yielding  only  23.67  per  cent  of  its 
estimated  potentialities  in  sales.  And  suppose  that  in  spite  of 
all  the  factual  data  presented  in  the  research  report,  the  sales 
manager  were  to  question  the  accuracy  of  the  study  and  refuse 
to  act  on  the  recommendations  concerning  that  territory.  He 
might  do  this  on  no  better  grounds  than  that  the  salesmen  in 
that  area  had  led  the  sales  force  in  volume  for  years;  that  the 
business  had  always  been  thoroughly  satisfactory  to  the  manage- 
ment or  that  such  a  discrepancy  between  potentialities  and 
results  was  not  supported  by  any  evidence  ever  before  presented 
by  anybody. 

It  is  not  likely  that  additional  factual  data  would  relieve  the 
doubt  that  might  be  generated  by  the  sales  manager  in  such  a 
situation.  It  is  to  be  presumed  that  the  research  man  did  a 
thoroughly  good  job  while  he  was  at  it.  There  is,  then,  nothing 
more  he  can  add.  Under  such  circumstances,  however,  he 
should  go  further  than  mere  data  to  make  his  study  effective. 
He  might,  for  instance,  recommend  an  experiment — as  was  done 
in  a  certain  almost  identical  case. 

In  the  case  referred  to,  the  research  man  urged  that  the  "star" 
salesman — who  was  so  manifestly  sleeping  on  the  firm's  oppor- 
tunities— be  promoted  (sic)  to  a  higher  type  of  work  for  which  he 
had,  of  course,  the  qualifications.  This  promotion  pleased  all 
of  his  old  friends  in  his  territory  and  preserved  them  for  his  suc- 
cessors. It  took  two  men  to  cover  his  territory  at  first — which 
was  a  further  compliment;  and  later  it  took  three  men;  but, 
together,  they  got  more  than  four  times  the  volume  out  of  that 
territory — and  at  a  lesser  cost  per  dollar  of  sales. 

There  may  be,  of  course,  other  circumstances  under  which  the 
research  man  must  hold  himself  ready  to  extend  his  service  in 
connection  with  a  completed  study.  Some  revisions  may  be 
necessary,  to  adjust  the  original  findings  to  a  new  objective  or  to 
bring  them  into  conformity  with  some  newly  developed  condition. 

Situations  of  this  sort,  even  while  growing  out  of  or  otherwise 
related  to  the  primary  research,  usually  take  on  the  aspect  of  a 
new  study.  The  "new  objective"  or  the  "newly  developed  con- 
dition" must  be  analyzed;  research  procedure  must  again  be 
planned;  new  data  must  be  collected,  organized  and  interpreted;  and 
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the  conclusions  must  be  set  up  for  presentation — as  with  the 
original  study.  Within  its  scope,  a  new  research  project  is 
begun,  to  be  pursued  to  its  logical  end  by  the  same  technique,  the 
same  process  of  study,  as  has  been  here  presented. 

Today's  Need  for  Marketing  Research 

This  treatise  opened  with  a  brief  reference  to  the  pronounced 
improvement  which  came  upon  the  production  processes  through 
the  medium  of  research.  It  takes  no  unusual  perception  to 
recognize  that  today  the  distribution  processes  require  a  develop- 
ment of  the  same  type  and  intensity.  That  it  cannot  begin  too 
soon  o<  be  pursued  too  vigorously,  is  manifest  from  the  following 
table,1  which  presents  an  analysis  of  corporation  tax  reports 
made  during  the  past  ten  years. 


Number  of  cor- 

Per 

Number  of  cor- 

Per 

Year 

Total 

porations  showing 

cent  of 

porations  showing 

cent  of 

reports 

net  income  for 
year 

total 

no  net  income 

total 

1925 

430,072 

252,334 

58.67 

177,738 

41.32 

1926 

455,320 

258,134 

56.69 

197,186 

43.31 

1927 

475,031 

259,849 

54.70 

165,826 

34.81 

1928 

495,892 

268,783 

54.20 

174,828 

35.25 

1929 

509,436 

269,430 

52.89 

186  ,'591 

36.62 

1930 

518,736 

221,420 

42.68 

241,616 

46.58 

1931 

516,404 

175,898 

34.06 

283,806 

54.96 

1932 

508,636 

82,646 

16.25 

369,238 

72.59 

1933 

504,080 

109,786 

21.78 

337,056 

66.86 

1934 

528,882 

145,089 

27.43 
41.34 

324,671 

61.39 

4,942,489 

2,043,369 

2,458,556 

49.74* 

*  Inactive  corporations,  submitting  no  data,  make  up  the  balance  in  percentage. 

This  table,  covering  five  fat  and  five  lean  years,  means  that  in 
the  course  of  that  ten-year  period  ending  with  1934 — the  latest 
for  which  figures  are  obtainable — the  Federal  government  had 
received  4,942,489  corporate  reports  and  that  only  41.34  per  cent 
of  that  number  showed  a  net  income,  while  49.74  per  cent  showed 
no  net  income. 

This  picture  of  futility  must  be  further  darkened  by  the  addi- 
tion of  thousands  upon  thousands  of  those  corporations  which 

1  Table  compiled  and  contributed  by  Standard  Statistics  Company,  Inc. 
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were  able  to  report  profits  but  whose  earnings  were  still  grossly 
inadequate  to  the  capital  employed  and  to  effort  expended. 
With  these  corporations  added,  the  percentage  of  fully  effective 
units  must  fall  considerably  below  41.34  per  cent.  Surely,  there 
is  something  amiss  with  a  system  which  tolerates  any  such  results. 

Doubtless,  every  one  of  these  quasi-successful  corporations  and 
every  one  of  the  two  and  a  half  millions  of  others  definitely 
reporting  in  the  red  during  the  past  ten-year  period  can  explain 
its  delinquency  to  its  own  satisfaction.  By  sheer  force  of  rhetoric 
they  may  have  been  able  to  pacify  their  stockholders  and  to 
preserve  their  administrators — the  rhetoricians  themselves — in 
office.  t 

But  all  that  is  of  no  consequence.  If  distribution  is  ever  to 
reach  the  proficiency  of  production,  if  commodities  are  ever  to  be 
made  available  at  right  prices  to  the  maximum  mass  of  buyers, 
if  ever  the  much  deplored  disparity  between  production  and 
consumption  is  to  be  leveled  off,  the  administrators  of  business 
will  have  to  do  more  than  explain  their  delinquencies.  "They 
will  have  to  prevent  them. 

To  a  large  extent  they  accomplished  this,  successfully,  in  pro- 
duction— by  study,  by  production  research.  They  identified 
waste — in  time,  power,  motion,  material — and  ruthlessly  weeded 
it  out.  What  waste  remains,  therefore,  to  destroy  the  profit 
opportunities  of  these  several  hundreds  of  thousands  of  corpora- 
tions, year  after  year,  must  lie  largely  in  their  distributing 
processes. 

This  waste,  too,  must  now  be  identified — by  study,  by  market- 
ing research.  And,  when  identified,  it  will  have  to  be  weeded 
out  just  as  ruthlessly.  Until  the  business  public — the  great 
body  of  investors  and  administrators — realizes  this  and  adjusts 
itself  resolutely  to  demand  marketing  research — as  a  disinter- 
ested, factual,  certified  safeguard  against  marketing  wastes — it 
is  fatuous  to  dream  of  a  truly  efficient  distribution  system. 


CHAPTER  XIX 
STATISTICAL  PROCEDURE  IN  MARKETING  RESEARCH 

In  this  brief  discussion  of  statistical  procedure,  it  is  intended 
merely  to  present  such  important  principles  and  methods  as 
often  find  application  in  the  statistics  of  marketing  research. 
The  research  man  whose  work  involves  extensive  use  of  statistical 
methods  must  fortify  his  work  library  with  several  standard 
texts  on  mathematical  statistics,  for  it  is  not  practicable  even 
for  an  advanced  statistician  to  remember  the  details  of  all  the 
methods  he  may  have  occasion  to  apply  in  his  work.  Hence,  this 
single  chapter  could  not  take  the  place  of  a  statistical  handbook. 

The  most  important  part,  or  at  least  the  largest  part,  of  the 
work  which  we  call  marketing  research,  consists  in  obtaining 
information  and  analyzing  it.  This  procedure  is  nothing  but  a 
specialized  process  of  logical  reasoning,  and  the  substance  of  any 
sound  marketing  investigation  is  an  orderly  body  of  facts  inte- 
grated to  a  logical  conclusion.  Most  of  these  facts  are  quan- 
titative, and  those  which  are  qualitative  usually  rest  upon  a 
quantitative  base. 

The  measurement  of  quantitative  data  is  the  function  of 
statistical  procedure.  A  mass  of  unorganized  data  usually  has 
very  little  meaning,  although  the  mass  may  include  ample  infor- 
mation for  a  positive  conclusion.  Even  when  organized  into 
the  most  orderly  arrangement  for  easy  comprehension,  the 
significant  relationships  and  trends  may  yet  lie  concealed.  They 
remain  to  be  discovered  and  clarified  through  mathematical 
steps  in  statistical  analysis.  Many  an  important  truth  has 
remained  hidden  because  the  investigator  failed  to  make  adequate 
use  of  such  methodology. 

Statistical  method  is  a  special  application  of  mathematics  which 
has  become  extremely  important  in  the  physical  and  social 
sciences,  government,  and  business.  It  is  only  recently  that 
any  considerable  use  has  been  made  of  statistical  analysis  in  the 
treatment  of  marketing  problems.  This  is  partly  due  to  the 
i  comparatively  recent  origin  of  the  economic  data  and  business 

357 


358  THE  TECHNIQUE  OF  MARKETING  RESEARCH 

records  necessary  for  statistical  study  in  this  field.  Also  the 
neglect  of  this  useful  tool  is  due  partly  to  the  fact  that  the  func- 
tion of  marketing  has  for  so  long  been  in  the  hands  of  the  old 
type  of  sales  executive  who  placed  first  importance  on  the  per- 
sonal factor  in  sales  and  had  little  use  for  study  and  analysis, 
depending,  instead,  upon  intuitive  judgment  and  an  extrovert's 
recollection  of  " practical  experience"  for  his  guides  in  making 
decisions. 

It  must  be  admitted  that  some  of  the  factors  in  a  marketing 
situation  are  more  or  less  intangible  and  cannot  readily  be  reduced 
to  analyzable  terms.  However,  this  is  no  reason  why  research 
methods  should  not  be  applied  at  least  to  those  factors  that  can 
be  analyzed.  If  any  guessing  needs  to  be  done,  it  should  be 
confined  to  those  gaps  in  the  tangible  data  which  cannot  be 
bridged  by  analysis.  The  less  guessing  the  better.  Positively 
determined  facts  should  replace  general  impressions,  wherever 
possible.  That  is  why  research  is  essential  to  the  marketing 
executive.  With  this  in  mind,  it  may  be  said  that  statistical 
method  is  to  the  research  man  what  research  is  to  the  marketing 
executive.  It  is  one  of  the  tools  which  help  to  make  the  research 
process  more  concrete.  Through  it,  many  of  the  apparent 
intangibles  are  given  tangible  form.  Expressing  relationships 
in  definite  numerical  terms  helps  to  place  any  research  on  a 
factual  basis  and  diminishes  the  personal  factor  as  an  element  in 
the  formulation  of  conclusions. 

In  the  usual  run  of  marketing  investigations,  there  seldom  is 
opportunity  or  need  for  the  more  advanced  statistical  technique 
often  found  useful  in  the  exact  sciences.  Extreme  refinements 
are  usually  unnecessary,  too,  for  marketing  data  ordinarily  con- 
tain unknown  " loaded"  errors  greater  than  the  theoretically 
probable  error  in  a  given  statistical  manipulation.  This  principle 
is  sometimes  overlooked  by  statisticians  who  place  too  great 
emphasis  upon  the  technique  of  their  craft.  The  higher  nights 
in  statistical  analysis  are  very  interesting  to  one  who  has  mastered 
them  and  it  is  easy  to  become  absorbed  in  the  beauties  of  a  bril- 
liant technical  exercise  in  statistical  theory,  while  losing  sight 
of  the  practical  realities  of  a  marketing  situation. 

A  reasonable  guide  for  every  research  man  who  loves  to  play 
with  equations  and  charts  is  a  rule  that  no  method  for  measuring 
data  need  be  a  great  deal  more  accurate  than  the  body  of  data. 
In  other  words,  a  statistical  method  which  introduces  a  probable 
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error  of  3  per  cent  in  the  correctness  of  the  answer  should  be 
entirely  adequate  for  analyzing  a  certain  body  of  data  which 
might  reasonably  contain  a  "loaded"  error  of  5  per  cent.  Too 
great  refinement  in  conclusions  drawn  from  comparatively  rough 
data  has  a  tendency  to  mislead  the  investigator  himself  as  to 
the  degree  of  reliability  in  his  own  conclusions. 

Examples  of  this  tendency  are  not  rare.  An  illustration  is  the 
case  where  a  certain  statistician  was  trying  to  measure  the  respec- 
tive influences  of  several  marketing  factors  in  causing  an  observed 
sales  increase.  The  method  of  multiple  correlation  was  used,  the 
analysis  being  made  on  the  basis  of  territorial  distribution.  The 
conclusion  of  the  study  was  that  factor  A  was  responsible  for 
62  per  cent  of  the  observed  sales  increase;  factor  B  received  credit 
for  27  per  cent  of  the  gain,  and  factor  C  was  found  to  account 
for  the  remaining  11  per  cent  of  the  rise  in  sales  volume.  This  is 
a  somewhat  simplified  version  of  the  actual  problem  but  it  will 
illustrate  the  principle.  Now  the  statistician  set  to  work  with 
his  refinements  and  determined  that  his  calculation  had  intro- 
duced a  probable  error  of  2.49  per  cent  in  the  answer.  This  made 
it  look  as  though  the  conclusion  itself  was  within  2.49  per  cent 
of  absolute  correctness,  which  was  entirely  misleading  because,  in 
this  particular  -case/the  basis  of  calculation  was  only  about  75  per 
cent  right.  The  investigator  had  consciously  excluded  several 
factors  which  were  known  to  affect  sales  volume  but  which  he 
was  unable  to  measure.  Their  omission  from  the  analysis  intro- 
duced an  original  error  far  greater  than  the  probable  error  meas- 
ured by  the  refinements  of  the  statistical  method  employed.  The 
point  is  that  the  secondary  calculation  was  worse  than  unneces- 
sary because  it  made  the  result  appear  more  reliable  than  it 
actually  was. 

In  applying  the  rule  that  a  method  of  measurement  need  not 
be  more  exact  than  the  data  measured,  it  is  important  to  consider 
the  data  as  a  body.  If  the  inaccuracies  of  individual  items  are 
not  of  a  biased  nature,  they  tend  to  offset  one  another,  and  sheer 
number  of  items  increases  the  reliability  of  the  mass.  Errors  of 
a  biased  nature,  or  loaded  errors,  are  those  which  tend  consist- 
ently in  only  one  direction,  due  to  some  definite  influence  upon 
the  original  data. 

For  example,  there  would  be  biased,  or  constant,  errors  in  a 
tabulation  of  weighings  made  on  scales  with  weak  springs.  Also, 
there  would  be  biased  errors  in  building-cost  data  obtained  from 
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construction  permits,  in  a  city  where  tax  assessments  are  based 
on  building  permits.  In  these  two  examples,  there  would  be 
many  accidental  errors  which  tend  to  offset  one  another  in  the 
original  data;  but  in  addition  to  these,  there  would  also  be  a 
special  influence  pulling  in  one  direction  only.  All  the  weight 
readings  would  tend  to  be  too  high,  and  the  figures  on  building 
costs  would  tend  to  be  too  low. 

If  the  scales  in  the  preceding  illustration  are  known  to  be  out 
of  balance  because  of  mistreatment,  but  the  direction  and  amount 
of  the  error  are  not  known,  then  we  have  a  case  of  concealed  bias. 
We  know  that  the  inaccuracies  in  the  individual  weighings  will 
not  offset  one  another  in  such  a  way  that  greater  accuracy  will 
result  from  increasing  the  number  of  weighings.  The  table  of 
weighings  can  be  analyzed  statistically  but  there  would  be  no 
sense  in  using  a  great  deal  of  refinement  in  an  effort  to  reduce  the 
probable  error  below  that  which  we  suspect  to  be  inherent  in  the 
scales  themselves. 

In  the  case  of  the  tabulation  of  building  costs,  we  know  that 
our  figures  have  a  tendency  to  be  too  low  but  we  do  not  know 
how  much  too  low.  If  we  suspect  that  the  average  of  all  the 
errors  is  approximately  a  minus  5  per  cent,  then  we  might  correct 
the  final  answer  by  raising  it  about  that  mueh,  but  whether  this 
correction  is  to  be  made  depends  entirely  on  how  the  figures  are 
to  be  used.  In  any  case,  this  factor  of  uncertainty  would  seem 
to  make  extreme  refinements  in  the  analyzing  process  appear 
rather  superfluous. 

Errors  tending  in  one  direction,  referred  to  as  biased,  constant, 
or  loaded  errors,  are  quite  different  from  compensating  errors. 

A  good  example  of  compensating  errors  is  the  tabulation  made 
by  a  large  retail  store  in  a  study  of  its  customers'  buying  habits. 
During  certain  days  of  the  week  and  in  the  various  seasons  of  the 
year,  the  number  of  customers  entering  the  store  was  counted, 
and  the  number  of  sales  slips  made  out  by  each  department  was 
recorded  together  with  the  total  amount  of  each  purchase  and 
the  number  of  items  on  each  slip.  This  resulted  in  a  great  mass 
of  data,  which  was  subjected  to  comprehensive  statistical  analysis. 
A  number  of  conclusions  were  reached  in  the  study,  grouped 
under  a  dozen  different  headings.  The  counting  of  the  customers 
entering  the  store  was  made  by  persons  trained  in  this  kind  of 
work,  but  no  such  count  can  be  perfect  and  the  resulting  data 


STATISTICAL  PROCEDURE  IN  MARKETING  RESEARCH    361 

obviously  contained  many  small  errors.  To  a  certain  degree,  this 
was  also  true  of  the  other  data  used  in  the  analysis.  However, 
many  different  persons  were  employed  in  assembling  and  com- 
piling the  data  and  many  precautions  were  taken  against  the 
introduction  of  any  errors  of  a  biased  nature.  That  is,  there 
were  no  known  factors  tending  to  make  the  data  consistently  too 
high  or  consistently  too  low.  In  this  case,  the  number  of  items 
in  the  compilation  was  so  extremely  large  in  proportion  to  the 
amount  of  likely  error  in  any  individual  item  that  statistical 
conclusions  could  be  drawn  with  great  accuracy.  The  analysis 
revealed  fundamental  trends  of  great  consistency,  with  relatively 
small  dispersion  in  the  individual  data.  Consequently,  it  was 
possible  to  make  use  of  refined  methods  of  statistical  analysis 
and  to  attach  significance  to  relatively  small  differentiations  in 
the  results.  This  was  a  case  in  which  it  would  have  been  a 
mistake  for  the  investigator  to  neglect  the  opportunity  of  using 
advanced  statistical  technique. 

Other  illustrations  of  data  which  would  permit  refinements  in 
statistical  procedure  are  the  record  of  hourly  and  daily  passengers 
in  the  transportation  system  of  a  great  city,  and  the  record  of 
telephone  calls  coming  through  a  huge  central  exchange.  These 
records  consist  of  millions  of  individual  items  and  the  errors  in 
compiling  them  are  not  only  small  but  are  likely  to  be  of  a  com- 
pensating nature.  In  making  internal  analyses  of  such  data,  it 
would  frequently  be  quite  proper  to  place  reliance  upon  conclu- 
sions drawn  from  complex  devices  of  analysis. 

The  foregoing  illustrations  are  intended  to  suggest  how  the 
character  of  data  in  any  given  case  determines  the  degree  of 
refinement  in  method  that  may  be  feasible  in  analyzing  them 
statistically.  In  some  instances,  it  is  folly  to  apply  advanced 
methods  of  statistical  research  and  in  other  cases  it  is  a  great 
mistake  not  to  use  such  methods.  It  takes  good  judgment  to 
determine  just  the  right  amount  of  exactness  in  method  to  make 
the  most  of  a  given  body  of  data  without  wasting  effort  on  the 
one  hand  or  risking  misleading  conclusions  on  the  other. 

Besides,  the  character  of  the  data  themselves,  there  is  also  the 
question,  of  course,  of  what  is  going  to  be  done  with  the  numerical 
answers  that  come  out  of  a  statistical  analysis.  The  intended 
use  of  these  measurements  largely  determines  the  degree  of 
accuracy  required  in  preparing  them. 
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These  considerations  raise  the  question  as  to  how  much  statis- 
tical theory  a  marketing  research  man  needs  to  know.  From 
college  student  to  research  director,  every  one  interested  in  this 
field  should  at  least  know  the  place  of  statistical  methodology 
in  the  field  of  marketing  investigations.  Particularly,  the 
research  director  who  may  be  in  position  to  employ  a  statistician 
should  have  a  fairly  thorough  understanding  of  the  processes  of 
statistical  research,  in  order  to  know  what  significance  is  to  be 
attached  to  the  results  of  a  particular  statistical  study.  The 
marketing  executive  usually  does  not  understand  statistical 
analysis,  even  when  shown  the  individual  steps  of  a  process. 
The  individual  in  charge  of  research  must  interpret  the  figures 
in  such  a  way  that  a  layman  will  know  just  what  they  mean,  that 
he  will  understand  in  layman's  terms  the  logic  of  the  method 
used,  and  that  he  will  know  how  near  the  conclusions  come  to 
being  what  may  be  called  positive  facts.  Any  textbook  on 
elementary  statistics  should  be  sufficient  to  give  the  requisite 
background  for  such  interpretation.  In  most  cases,  advanced 
statistical  methods  will  be  sufficiently  available  in  a  reference 
book  ready  for  such  use  as  occasion  may  require. 

The  following  sections  will  explain  a  few  statistical  concepts 
most  often  applied  in  the  solution  of  problems  encountered  in 
marketing  investigations. 

Bands  of  Data.  Statistical  analyses  are  used  chiefly  in  connec- 
tion with  fairly  large  collections  of  data.  Isolated  figures  and 
very  small  groups  of  items  cannot  be  thus  analyzed,  for  the 
essence  of  statistical  analysis  is  the  study  of  interrelationships  of 
data  in  a  body. 

The  first  thing  that  is  done  with  any  kind  of  data  is  to  tabulate 
them  in  some  orderly  form.  Common  sense  and  experience  will 
determine  how  tabulations  should  be  made.  Some  textbooks 
go  into  considerable  detail  to  describe  various  forms  and  methods 
of  tabulation,  but  that  is  not  necessary  here. 

The  most  common  kinds  of  tabulations  of  data  as  arranged  for 
statistical  analysis  are  frequency  series  and  time  series. 

A  frequency  series  is  a  collection  of  data  so  organized  as  to 
reveal  the  frequency  with  which  given  values  occur  in  the  body 
of  data.  A  good  example  would  be  a  tabulation  taken  from 
income  tax  returns,  showing  the  number  of  taxpayers  in  each 
income  bracket.     In  the  first  column  would  be  listed  the  various 
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income  brackets,  such  as:  zero  to  $500;  $501  to  $1,000;  $1,001  to 
$1,500;  $1,501  to  $2,000;  etc.  The  second  column  would  show 
the  number  o£  income  tax  returns  falling  within  each  of  these 
brackets.  Another  typical  frequency  series  would  be  a  table 
showing  the  height  distribution  of  soldiers.  The  figures  would 
give  the  number  of  men  who  come  within  each  height  category, 
proceeding  by  inches  or  fractions  of  inches. 

In  a  frequency  series,  the  time  factor  is  never  used  as  the 
guide  for  tabulation.  The  question  of  when  is  not  a  consideration 
in  tabulating.  The  figures  are  always  concerned  with  how  many 
items  of  data  occur  within  each  unit  of  measurement  along  the 
index  scale  of  values.  In  other  words,  the  table  shows  the  fre- 
quency with  which  each  value  occurs  in  the  series  of  data,  which 
is  then  to  be  analyzed  for  information  as  to  the  manner  of  dis- 
tribution of  these  values  along  their  scale  of  magnitude.  For  this 
reason,  a  frequency  series  is  usually  referred  to  as  a  frequency 
distribution. 

A  time  series  is  a  body  of  data  arranged  chronologically,  or 
historically.  A  record  of  monthly  sales  is  a  time  series.  Other 
common  time  series  are  economic  data  such  as  daily,  weekly,  or 
monthly  stock  prices,  the  annual  production  of  pig  iron,  or  a 
company's  monthly  expenditures  for  advertising.  In  these 
series,  the  time  factor  is  the  guide  for  tabulation.  Sometimes 
the  items  in  a  time  series  may  be  retabulated  in  the  form  of  a 
frequency  distribution,  in  which  case  the  time  factor  is  ignored 
and  some  other  element  is  used  as  the  basis  for  tabulation.  The 
form  of  compilation  depends  upon  the  kind  of  information  which 
it  is  desired  to  obtain  from  the  intended  analysis. 

Averages.  The  oldest  and  simplest  statistical  device  is  the 
average.  An  average  is  a  single  number  expressing  a  quantity 
or  value  representative  of  a  collection  of  similar  numerical  data. 
The  primary  function  of  an  average  is  to  simplify  the  task  of  the 
human  mind  in  comprehending  a  series  of  measurements.  When 
confronted  by  a  large  number  of  quantitative  items,  we  tend 
unconsciously  to  average  them.  After  walking  through  a  corn- 
field on  the  fourth  of  July,  we  have  an  impression  of  the  average 
height  of  the  thousands  of  individual  stalks.  We  may  distinctly 
recall  some  exceptionally  high  and  exceptionally  short  stalks  but 
these  do  not  disturb  our  general  impression  that  the  stalks  in 
this  field  of  young  corn  are  about  knee-high.     It  is  very  necessary 
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to  have  such  an  impression  if  we  wish  to  make  any  intelligent 
comment  on  the  height  of  the  corn  in  a  particular  field.  If  we 
should  speak  chiefly  of  the  tallest  and  the  shortest  stalks,  the 
statement  would  likely  be  misleading.  So  we  speak  of  the  aver- 
age height  of  the  corn,  which  at  that  time  of  year  might  be  the 
most  important  fact  about  the  corn. 

In  the  case  of  more  accurate  data,  such  as  the  income  tax 
returns  from  a  community,  it  is  equally  necessary  to  have  aver- 
ages or  representative  figures  to  help  the  mind  grasp  the  situa- 
tion. Even  if  we  should  memorize  perfectly  all  the  figures  on  a 
thousand  income  tax  returns,  we  would  not  have  so  good  an 
understanding  of  these  persons'  incomes  as  could  be  obtained  from 
a  single  figure  representing  the  average  of  the  whole  thousand. 
The  word  " average"  as  generally  used  is  a  rather  loose  expres- 
sion, and  in  statistical  terminology  it  has  retained  its  dictionary 
meaning,  which  is  broad  enough  to  mean  any  number  calculated 
to  represent  a  collection  of  like  items.  Averages  are  computed 
in  different  ways,  depending  upon  the  character  of  the  items  to 
be  averaged  and  upon  the  use  which  is  to  be  made  of  the  average 
figure. 

Besides  being  the  commonest  and  simplest  of  all  statistical 
devices,  the  average  is  also  the  most  frequently  misused  device. 
The  nonmathematical-minded  person  does  not  realize  how  great 
are  the  pitfalls  and  the  opportunities  for  false  reasoning  through 
erroneous  use  of  averages.  Often  a  totally  wrong  concept  results 
from  " averaging  up"  a  series  of  quantities  or  values.  When 
a  research  man  reports  that  the  average  rental  value  of  residences 
in  a  certain  community  is  thirty-eight  dollars  per  month,  he 
should  know  positively  that  the  method  of  averaging  has  been 
such  as  to  make  this  figure  really  representative  of  the  homes  in 
the  community,  as  judged  from  the  standpoint  of  the  situation 
in  which  this  figure  is  to  be  applied.  The  most  common  methods 
for  computing  averages,  and  their  uses,  are  stated  in  the  following 
paragraphs. 

The  arithmetic  mean  is  the  statistical  measure  which  most 
people  know  as  the  " simple  average."  It  is  simply  the  sum  of  all 
the  items,  divided  by  the  number  of  items. 

The  weighted  average  is  a  modification  of  the  arithmetic  mean 
in  which  the  individual  items  are  assigned  varying  amounts  of 
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influence  in  determining  the  average,  depending  upon  the  relative 
importance  or  reliability  of  each  item. 

The  harmonic  mean  and  the  geometric  mean  are  special  devices, 
defined  on  subsequent  pages. 

The  median  is  the  middle-sized  item  in  a  series  of  data.  One- 
half  of  all  the  individual  items  are  larger  and  one-half  of  the  items 
are  smaller  than  the  median. 

The  mode  is  the  figure  which  represents  the  most  commonly 
occurring  size  of  all  the  items  in  a  series  of  data.  When  the 
items  are  all  arranged  in  their  order  of  size,  the  mode  is  that 
particular  size  about  which  is  to  be  found  the  largest  concentra- 
tion of  items. 

It  is  very  important  to  know  which  of  these  types  of  averages 
to  use  in  a  given  situation.  As  stated  before,  the  selection  will 
depend  upon  the  character  of  the  data  and  the  purpose  for  which 
the  average  is  to  be  used. 

Arithmetic  Mean.  Since  the  arithmetic  mean  is  the  simplest 
kind  of  average,  as  to  both  concept  and  method  of  computation, 
it  will  be  used  as  a  first  choice  except  where  there  is  a  definite 
reason  to  compute  another  type  of  average.  As  an  example  of  a 
legitimate  use  of  the  arithmetic  mean  might  be  cited  the  average 
consumption  of  electric  current  per  tenant  by  all  the  residents  in 
a  group  of  apartment  houses.  It  might  be  useful  to  have  this 
information  for  some  purpose  or  other,  and  any  other  form  of 
average  might  be  less  significant  than  the  arithmetic  mean.  In 
this  illustration,  the  mean  would  enable  the  power  company  to 
determine  how  much  more  power  would  be  needed  to  supply 
additional  apartment  houses  of  similar  character.  There  would 
be  no  purpose  in  computation  of  weighted  averages,  modes,  or 
medians.  The  items  of  data  are  all  strictly  comparable  and  all 
have  equal  validity.  If  the  power  company  for  some  reason 
wishes  to  know  how  much  current  is  used  in  apartments  of  vary- 
ing numbers  of  rooms,  the  obvious  method  would  be  to  compute 
an  arithmetic  mean  of  the  current  consumed  in  all  one-room 
apartments,  the  amount  consumed  in  all  two-room  apartments, 
and  so  on,  computing  a  separate  average  for  each  class  of  apart- 
ments by  size. 

The  average  daily  circulation  of  a  newspaper,  excepting  Sun- 
day, is  logically  an  arithmetic  mean  of  the  period  under  exam- 
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ination.  No  other  kind  of  average  would  have  any  greater 
significance  nor  would  it  be  as  useful. 

The  average  size  of  native  white  families  living  on  farms  in 
the  United  States  is  a  certain  number  of  persons  calculated  to  the 
first  decimal.  An  arithmetic  mean  is  the  usual  method  for 
computing  this  average. 

Weighted  Average.  Turning  now  to  other  types  of  illustra- 
tions, the  need  for  other  methods  of  figuring  averages  becomes 
evident.  The  use  of  the  simple  arithmetic  mean  is  sometimes 
prohibited  by  the  nature  of  the  data  or  the  kind  of  use  to  which 
the  information  is  to  be  put. 

An  ideal  example  to  illustrate  the  use  of  the  weighted  average, 
for  instance,  is  a  calculation  of  relative  commodity  price  levels. 
When  a  mail-order  house  publishes  a  new  catalogue,  it  is 
impossible  to  put  through  a  uniform  percentage  of  increase  or 
decrease  on  all  items.  Various  lines  of  goods  fluctuate  widely  in 
price  and  there  is  no  uniformity  of  movement  among  them.  In 
computing  the  new  price  list,  each  item  must  be  figured  inde- 
pendently of  the  others.  After  the  new  price  list  has  been  set 
up,  it  is  desired  to  know  how  the  entire  list  compares  with  the 
previous  catalogue.  It  would  be  entirely  wrong  and  misleading 
to  describe  the  change  in  price  of  the  company's  products  by 
comparing  arithmetic  means,  or  simple  averages.  The  reason 
is  that  some  items  sell  in  heavy  volume  and  others  in  small  quan- 
tities. It  is  quite  possible  that  a  reduction  of  2  per  cent  in  the 
price  of  one  heavy-volume  item  would  have  much  greater  influ- 
ence on  the  business  as  a  whole  than  a  decline  of  15  per  cent  in 
ten  unimportant  items.  Using  the  arithmetic  mean,  these  eleven 
items  combined  would  show  an  average  decrease  in  price  amount- 
ing to  13.8  per  cent.  But  if  the  one  heavy  item  accounts  for  as 
much  in  sales  as  the  other  ten  items  combined,  then  the  real 
price  decrease  for  these  eleven  items  will  be  only  8.5  per  cent, 
based  on  dollar  volume.  This  percentage  is  obtained  by  comput- 
ing a  weighted  average.  It  is  to  be  remarked  that  anyone  with 
a  logical  mind  would  arrive  at  the  correct  result  without  having 
heard  of  the  term  " weighted  average,"  and  for  that  reason  the 
foregoing  example  furnishes  a  good  illustration  of  what  a  weighted 
average  really  is. 

A  splendid  example  in  the  use  of  weighted  averages  is  the  index 
of  wholesale  prices   computed  monthly  and  annually  by  the 
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U.  S.  Bureau  of  Labor  Statistics.  The  price  changes  in  several 
hundred  commodities  are  used  to  make  up  this  index.  In  deter- 
mining the  net  change  in  the  index,  each  commodity  is  made  to 
exercise  just  the  proportionate  amount  of  influence  to  which  its 
importance  entitles  it.  This  relative  importance  is  decided  on 
the  basis  of  census  figures.  In  referring  to  the  computation  of 
this  combined  price  index,  it  is  said  that  the  price  changes  in 
individual  commodities  are  " weighted' '  by  production  or  sales 
figures,  and  are  then  averaged. 

Emphasis  on  the  method  of  weighted  averages  seems  desirable 
in  this  summary  of  statistical  procedure,  because  the  principle 
of  weighting  is  too  often  ignored  in  everyday  matters  where  it 
should  be  applied.  The  method  is  extremely  simple,  as  shown  in 
the  following  illustration. 

A  company  desires  to  make  a  forecast  of  next  year's  demand  for 
its  type  of  product.  The  sales  area  covered  by  this  company  is 
divided  into  five  territories.  After  studying  the  information 
furnished  by  a  statistical  service,  supplemented  by  the  company's 
own  observations,  a  rough  forecast  is  made  of  the  change  in 
demand  in  each  of  the  five  territories.  It  is  estimated  that  in 
three  of  these  territories  the  demand  will  increase  in  varying 
proportions.  In  the  fourth  territory,  no  change  is  anticipated, 
and  in  the  fifth,  it  is  expected  that  demand  will  be  less  than  in 
the  year  just  ended.  The  problem  is  to  combine  the  five  per- 
centages to  make  an  average  forecast  of  demand  in  the  entire 
region  served  by  the  company.  The  answer  obviously  must  be 
a  weighted  average.  The  change  in  demand,  as  forecast  for  each 
territory,  is  weighted  by  a  figure  representing  the  relative  volume 
of  sales  normally  coming  from  the  territory,  for  this  figure  is  a 
measure  of  the  importance  of  the  territory.  The  process  is 
shown  in  the  table  below. 


Territory 


V 
W 
X 
Y 
Z 


Forecast  of  change 
in  demand  (per  cent) 


+14 
+  2 
+  8 
No  change 
-24 


B 


Normal  distribution 
of  sales 


10 
20 
10 
25 
35 


AXB 
Weighted  forecast 


+140 
+  40 
+  80 
0 
-840 


Totals 

Weighted  average 


100 


-580 
•5.8  per  cent 
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Assuming  that  the  forecast  for  each  territory  is  reliable,  the 
forecast  for  the  company's  entire  market  is  a  drop  of  5.8  per  cent 
in  demand.  If  a  simple  arithmetic  mean  had  been  taken,  the 
answer  would  have  been  zero,  or  no  change  in  demand. 

Harmonic  Mean.  In  the  following  example  of  consumer 
research,  it  was  desired  to  state  a  figure  showing  how  many  days 
a  pound  of  coffee  lasts,  on  the  average,  in  the  households  of  a 
certain  small  group  of  persons.  The  following  information  was 
secured: 

One  pound  of 
coffee  lasts 

Consumer  A 10  days 

Consumer  B 6  days 

Consumer  C 30  days 

Consumer  D 5  days 

Consumer  E g    14  days 

5)65 

Arithmetic  mean 13  days 

The  apparent  average  frequency  of  purchase  by  these  five  con- 
sumers is  one  pound  of  coffee  every  13  days,  which  is  incorrect. 
Each  consumer  using  a  pound  every  13  days  would  use  36%3, 
or  *28.1  pounds  per  year,  which,  multiplied  by  5,  would  make  a 
total  consumption  of  140.5  pounds  by  the  five  consumers.  This 
is  badly  wrong,  because: 

Consumer  A  uses  365  -f-  10  =  36 . 5  lb.  per  year 

Consumer  B  uses  365  ■*-    6  =  60 . 8  lb.  per  year 

Consumer  C  uses  365  -f-  30  =  12.2  lb.  per  year 

Consumer  D  uses  365  -t-    5  =  73 . 0  lb.  per  year 

Consumer  E  uses  365  4-  14  =  26. 1  lb.  per  year 

Total  consumption  is  208.6  lb.  per  year  (as  compared 

with  140.5,  above) 

Hence  the  average  consumer  uses  208.6/5,  or  41.7  pounds  per 
year,  which  is  the  same  as  one  pound  every  365/41.7,  or  8.8 
days  (as  compared  with  13,  above). 

This  correct  solution  can  also  be  obtained  directly  from  the 
five  orginal  numbers,  10  days,  6  days,  30  days,  5  days,  and  14 
days,  as  follows: 

ysiVio  +  U  +  Vso  +  H  +  Via)  =  8'8  dayS 


STATISTICAL  PROCEDURE  IN  MARKETING  RESEARCH    369 

Obtained  by  this  method,  the  answer  is  called  the  harmonic  mean 
of  the  original  numbers.  It  is  the  reciprocal  of  the  arithmetic 
mean  of  the  reciprocals  of  the  individual  items. 

The  type  of  problem  requiring  use  of  the  harmonic  mean  is 
made  clear  by  studying  the  original  data  in  the  above  example 
to  see  why  the  first  solution  gave  a  wrong  answer.  The 
correct  solution  involves  a  principle  related  to  that  of  weighted 
averages. 

Geometric  Mean.  In  a  series  of  measurements  representing 
rates  of  change,  the  average  rate  is  generally  best  represented  by 
the  geometric  mean  of  the  individual  measurements.  It  is  found 
by  taking  the  nth  root  of  the  product  of  n  measurements. 

For  example,  if  the  prices  of  5  commodities  have  changed  from 
100  in  a  certain  base  period  to  the  respective  levels  of  120, 
80,  210,  40,  and  110,  the  geometric  mean  of  the  new  prices  is 
^120  X  80  X  210  X  40  X  HO,  or  97.6.  The  arithmetic  mean 
of  the  five  price  numbers  would  be  112. 

In  this  case,  the  geometric  mean  is  considered  the  representative 
measure  of  the  average  intensity  and  direction  of  the  forces  oper- 
ating to  cause  the  price  changes  above  recorded.  According  to 
this  principle,  equal  forces  would  tend  to  cause  equal  percentages 
of  price  change  rather  than  equal  absolute  amounts.  Also, 
downward  changes  are  given  more  weight  than  equivalent 
upward  changes,  on  the  theory  that  it  takes  more  force  to  cause  a 
decrease  of  50  per  cent  than  to  cause  an  increase  of  50  per  cent. 
This  is  based  on  the  fact  that  the  greatest  possible  decrease  is 
only  100  per  cent,  whereas  there  is  no  limit  to  the  possible  amount 
of  increase. 

The  geometric  mean  should  be  used  in  cases  where  this  principle 
is  important.  It  is  not  recommended,  however,  as  a  measure  of 
the  actual  status  of  the  price  level  of  a  specific  list  of  commodities, 
in  which  an  ordinary  weighted  average  is  more  true. 

The  Median  and  the  Mode.  The  other  two  general  types  of 
averages  are  the  median  and  the  mode.  Both  are  easy  to  deter- 
mine, as  indicated  in  a  previous  paragraph,  but  mistakes  are 
often  made  in  selecting  the  one  to  use. 

Since  the  median  is  the  middle  point,  with  half  of  all  the  items 
above  it  and  half  of  them  below  it,  this  method  gives  equal  impor- 
tance to  every  item  in  the  table.  Those  items  that  are  extremely 
high  or  extremely  low  have  no  greater  and  no  less  influence  in 


370  THE  TECHNIQUE  OF  MARKETING  RESEARCH 

raising  or  lowering  the  median  than  if  they  were  only  moderately 
high  or  moderately  low. 

The  mode,  on  the  other  hand,  represents  the  center  of  the 
largest  cluster  of  items  on  the  scale  and  has  the  effect  of  completely 
ignoring  stray  items  that  happen  to  be  far  removed  above  or 
below  the  cluster. 

While  the  median  is  the  true  middle  value  for  all  the  individual 
measurements,  the  mode  is  the  value  nearest  to  the  greatest 
number  of  these  measurements. 

A  simple  and  graphical  method  for  determining  the  median  of  a 
collection  of  numbers  is  to  start  by  listing  all  the  numbers  in  a 
single  column,  arranged  in  their  order  of  size,  smallest  at  the  top 
and  largest  at  the  bottom.  The  number  in  the  exact  middle  of 
the  column  is  the  median.  For  example,  if  there  are  93  numbers, 
the  value  of  the  47th  number  is  the  median  value.  If  there  should 
be  just  92  numbers,  the  median  is  half-way  between  the  46th  and 
47th  numbers.  . 

In  finding  the  mode,  the  most  graphical  and  objective  method  is 
to  begin  by  drawing  a  horizontal  line  on  plain  paper.  Equal 
spaces  marked  off  on  the  line  will  represent  a  scale  of  values, 
running  from  zero  through  the  highest  number  in  the  collection 
of  data.  Touching  the  line  on  its  upper  side  are  placed  uniformly 
sized  black  dots,  each  dot  representing  one  of  the  individual 
numbers  whose  mode  is  to  be  determined.  The  position  of  each 
dot  on  the  scale  records  the  value  of  the  number  it  represents. 
Where  the  density  of  dots  will  not  permit  them  all  to  lie  side  by 
side  along  the  line,  they  are  made  to  pile  up  like  solid  pieces  of 
shot.  Viewing  the  completed  drawing,  one  should  be  able  to 
recognize  a  fairly  definite  area  of  greatest  concentration  of  dots. 
By  eye,  as  well  as  by  any  other  method,  one  can  find  the  place 
which  appears  to  be  the  center  of  this  concentration.  In  case  of 
doubt,  various  points  may  be  tested  by  counting  the  number  of 
dots  which  occur  within  a  certain  distance  of  each  point.  The 
point  of  greatest  concentration  is  read  off  on  the  scale  and  the 
resulting  value  is  the  mode. 

Textbooks  give  other  methods  for  finding  the  mode,  but  the 
above  procedure  will  probably  give  the  clearest  understanding 
of  what  the  mode  really  is.  With  this  understanding,  the  research 
man  can  readily  devise  his  own  method  to  suit  a  particular  situa- 
tion     It  is  to  be  borne  in  mind  that  the  mode  is  not  an  exact 
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mathematical  concept  and  no  amount  of  complex  procedure  can 
make  it  so.  Another  caution  which  should  be  given  with  this 
explanation  is  not  to  use  the  mode  in  any  case  where  its  existence 
is  not  visible  to  the  eye.  When  the  investigator  is  convinced  that 
a  mode  clearly  exists,  he  is  justified  in  using  mathematical  calcula- 
tions to  determine  its  value.  But  to  compute  the  mode  for  a 
body  of  data  which  does  not  contain  an  area  of  concentration,  or 
bunching  of  values,  is  a  form  of  deception  and  should  be  avoided. 

The  question  as  to  whether  the  median  or  the  mode  is  to  be 
used  in  a  given  case  depends  both  on  the  character  of  data  and  on 
the  purpose  for  which  the  figure  is  to  be  used. 

As  to  character  of  data,  the  general  rule  is  that  a  high  degree  of 
scatter,  together  with  the  absence  of  any  well-defined  central 
tendency,  calls  for  the  use  of  the  median.  On  the  other  hand,  a 
lesser  degree  of  scatter,  together  with  a  definite  tendency  to  cluster 
about  a  central  value,  suggests  the  use  of  the  mode.  In  case  of 
doubt,  the  median  is  to  be  preferred,  as  it  is  more  definite  than 
the  mode. 

The  manner  in  which  the  median  or  mode  is  to  be  used  often 
determines  the  choice  between  the  two.  The  decision  should  not 
be  difficult  in  any  given  case,  if  the  literal  meaning  of  the  two 
terms  is  kept  in  mind.  A  simple  illustration  helps  to  make  this 
clear. 

Suppose,  for  example,  that  we  have  complete  data  on  the 
incomes  of  all  the  families  in  a  certain  residential  area  and  want 
a  figure  representing  income  of  the  average  family  in  this  area, 
in  order  to  compare  it  with  similar  figures  for  other  areas.  The 
arithmetic  mean  would  not  be  suitable  for  this  purpose,  because 
it  gives  too  much  weight  to  the  exceptionally  high  and  excep- 
tionally low  individual  incomes.  In  this  case,  the  best  figure  to 
use  is  the  median,  for  it  is  the  truest  representative  value  for  all 
the  families  in  the  area. 

Suppose,  now,  that  we  are  studying  the  same  original  data  for 
a  somewhat  different  purpose.  A  merchandising  appeal  is  being 
planned  for  the  people  living  in  this  particular  residential  area. 
We  want  to  know  what  income  level  the  appeal  should  be  keyed 
to,  in  order  that  the  greatest  possible  number  of  families  may  be 
influenced.  Now  we  use  the  mode,  rather  than  the  median,  for 
by  definition  the  modal  value  is  the  figure  closest  to  the  greatest 
number  of  individual  incomes. 
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Measures  of  Variation.  Having  determined  an  average  value 
by  which  to  represent  all  the  items  in  a  body  of  data,  it  is  some- 
times useful  to  find  a  measure  expressing  the  degree  of  scatter 
among  the  individual  items.  In  other  words,  how  closely  are  the 
data  grouped  about  the  average  value,  or  how  wide  is  their  dis- 
persion?    Following  are  some  of  the  devices  used  to  describe  the 

tendency. 

The  range  is  the  difference  in  value  between  the  highest  and  the 
lowest  of  a  series  of  measurements.  It  is  the  linear  measure  of 
the  ground  covered  by  a  body  of  data. 

The  mean  deviation  is  the  average  amount  by  which  all  the 
numbers  in  a  group  deviate  from  their  central,  or  average,  value. 
After  establishing  the  median,  for  instance,  a  table  is  made 
showing  how  much  each  number  in  the  group  differs  from  the 
median.  The  arithmetic  mean  of  these  differences  is  the  mean 
deviation. 

This  is  a  most  useful  aid  in  describing  the  characteristics  of  a 
series  of  measurements. 

The  standard  deviation  is  a  more  formal  mathematical  measure 
than  the  mean  deviation.  It  is  always  calculated  from  the 
arithmetic  mean  of  a  series  of  values.  It  is  found  by  extracting 
the  square  root  of  the  sum  of  the  squares  of  all  the  individual 
deviations  from  the  arithmetic  mean. 

The  standard  deviation  is  used  in  some  of  the  more  involved 
processes  of  statistical  analysis. 

Probable  Error.  The  probable  error  may  be  described  as  the 
theoretical  amount  of  error  most  likely  to  be  present  in  any  indi- 
vidual measurement.  In  a  given  series  of  measurements  with 
" normal"  distribution,  that  is,  varying  in  accordance  with  the 
laws  of  pure  chance,  one-half  of  all  the  values  differ  from  the 
arithmetic  mean  by  an  amount  less  than  the  probable  error,  and 
one-half  differ  by  more  than  that  amount.  The  probable  error 
may  be  found  by  multiplying  the  decimal  0.6745  by  the  standard 
deviation. 

Since  marketing  data  often  are  inclined  to  be  erratic,  departing 
widely  from  the  normal  curve  of  frequency  distributions,  they 
frequently  do  not  permit  valid  application  of  the  theory  of  prob- 
able error. 

Trend  Lines  in  Frequency  Distributions.  In'  a  following  sec- 
tion, methods  will  be  described  for  determining  secular  trend  in 
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time  series.  In  the  examples  and  in  the  explanation  of  method, 
only  chronological  data  will  be  dealt  with,  the  word  "  trend  "  being 
used  to  mean  change  taking  place  over  a  period  of  time. 

However,  it  is  also  possible  thus  to  analyze  trends  in  frequency 
distributions.  When  such  data  have  been  plotted  on  a  chart, 
using  a  dot  to  represent  each  item,  a  trend  is  sometimes  clearly 
visible  in  the  plotted  points.  In  other  words,  it  appears  as 
though  a  line  might  be  drawn  to  represent  the  average  tendency 
of  the  points  to  become  higher  or  lower  as  the  eye  travels  from 
left  to  right  on  the  chart. 

Suppose,  for  example,  that  in  a  survey  of  the  market  for  camp- 
ing equipment,  the  investigator  has  compiled  figures  for  many 
cities  on  the  number  of  persons  who  go  on  camping  trips.  In 
addition  to  other  information,  it  is  desired  to  determine  the 
influence  of  a  city's  size  on  the  camping  propensities  of  its  inhabit- 
ants. The  presumption  is  that  in  small  towns  a  larger  proportion 
of  people  go  camping  than  in  large  cities.  The  question  is  how 
great  is  this  difference,  in  relation  to  the  variation  in  size  of 
cities. 

After  suitable  tabulation,  the  data  are  plotted  on  ordinary 
graph  paper.  The  horizontal  distances,  measured  along  the  x 
axis,  represent  the  size  of  cities.  The  vertical  heights,  measured 
on  the  y  axis,  represent  the  number  of  campers  per  thousand 
inhabitants.  One  point  is  plotted  for  each  city,  its  location  on 
the  chart  indicating  the  size  of  the  city  and  the  proportion  of 
campers. 

The  dots  are  pretty  well  scattered  on  the  chart,  but  it  is  clearly 
apparent  that,  taking  them  in  the  mass,  there  is  a  tendency  for 
the  dots  to  average  considerably  lower  as  the  eye  travels  from 
left  to  right.  A  line  drawn  through  the  dots  would  slope  down- 
ward to  the  right,  and  such  a  line  could  represent  the  average 
influence  of  a  city's  size  on  the  camping  habits  of  its  people. 
Rather  than  guess  at  the  location  of  such  a  line,  it  may  be 
desirable  to  compute  it  statistically. 

This  problem  can  be  solved  by  the  same  methods  as  described 
in  the  next  section  for  time  series.  It  is  only  necessary  to  sub- 
stitute the  sizes  of  cities,  or  x  values,  on  the  chart,  for  the  time 
units  in  the  examples  given.  The  method  illustrated  in  Table  III, 
on  page  379,  would  probably  be  found  applicable  in  the  above 
case. 
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Trends  and  Variations  in  Time  Series.  A  collection  of  data 
arranged  in  the  order  of  chronological  sequence  of  the  individual 
items  is  a  time  series.  The  time-flow  factor  is  the  basis  for 
tabulation.  All  analyses  of  time  series  are  concerned  with 
observed  changes  in  given  measurements,  which  have  taken  place 
during  known  intervals  of  time.  Most  marketing  investigations 
include  this  type  of  statistical  analysis  at  some  point  or  other. 

The  changes  in  observed  measurements  are  of  two  general 
types:  permanent  changes,  and  recurring  fluctuations.  Per- 
manent, or  long-term,  changes  are  called  secular  trend.  Fluc- 
tuations are  of  three  kinds,  seasonal  variations,  other  periodic 
cycles,  and  irregular  fluctuations.  The  analysis  of  a  time  series 
usually  includes  the  study  of  one  or  more  of  these  phenomena. 

One  of  the  most  useful  of  all  aids  in  the  analysis  of  any  time 
series  is  visualization  of  the  series  through  plotting  the  data  on 
graph  paper.  This  gives  the  investigator  a  better  grasp  of  his 
problem  than  almost  anything  else  he  could  do.  The  graph,  or 
curve,  reveals  the  general  character  of  a  time  series,  the  .nature 
of  fluctuations,  and  the  steps  which  ought  to  be  taken  in  analyz- 
ing the  problem.  For  the  beginner,  it  is  good  advice  to  urge  the 
habit  of  plotting  his  data  at  every  possible  stage  of  the  analysis, 
making  a  fetish  of  maintaining  a  continuous  visual  concept  of 
what  he  is  doing.  Often  this  takes  extra  time,  but  usually  the 
investigator  is  rewarded  by  a  more  complete  mastery  of  his 
problem. 

Secular  Trend.  The  long-term  tendency  in  a  time  series  is 
usually  discernible  in  the  plotted  data.  Inspection  will  show 
whether  the  average  trend  seems  to  follow  a  straight  line  or  a 
curve.  If  the  trend  is  curved,  it  is  helpful  to  know  how  to  recog- 
nize what  standard  type  of  curve  it  resembles.  The  simplest 
method  is  to  sketch  in  the  apparent  average  curve  by  eye  and 
then  compare  it  with  the  various  illustrations  found  in  textbooks. 
A  flexible  ruler  is  a  helpful  device  in  this  connection. 

The  determination  of  secular  trend  is  sometimes  a  complicated 
and  laborious  process.  Ordinarily,  however,  the  problems 
encountered  in  marketing  research  will  yield  to  the  simpler 
methods  of  solution.  In  the  present  brief  treatment,  only 
the  most  common  types  of  trend  will  be  reviewed.  In  cases 
where  these  do  not  suffice,  statistical  reference  books  should  be 
consulted. 
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The  first  type  of  secular  trend  to  be  considered  here  is  the 
straight-line  trend.  It  is  possible  to  make  statistical  tests  of  the 
data  in  a  time  series  to  see  whether  it  would  be  correct  to  repre- 

Table  I: — Straight-line  Trend 
(Time  intervals  uniform  in  length  and  odd  in  number) 


1 

2 

3 

4 

Year 

Sales  in  thou- 
sands of  dollars 

Distance  from 
middle  year 

Column  1 

multiplied  by 

column  2 

Squares  of 
figures  in 
column  2 

1921 

756 

-4 

-  3,024 

16 

1922 

1,052 

-3 

-  3,156 

9 

1923 

1,319 

-2 

-  2,638 

4 

1924 

1,401 

-1 

-   1,401 

1 

-10,219 

1925 

1,649 

0 

0 

0 

1926 

1,892 

+1 

+  1,892 

1 

1927 

2,006 

+2 

+  4,012 

4 

1928 

2,243 

+3 

+  6,729 

9 

4929 

2,561 

+4 

+  10,244 

16 

+22,877 

Totals 

14,879 

0 

+  12,658 

60 

Value  assignable  to  middle  year  is  arithmetic  mean  of  all  years. 


14,879 
9 


=  1,653  =  middle  point  of  trend  line,  at  1925 


Annual  rise  in  trend  line  is  total  of  Column  3  divided  by  total  of  Column  4. 
12,658 


60 


=  210.97  =  increase  per  year 


Value  assignable  to  first  year,  four  years  back  from  middle — 

1,653  -  4  X  210.97  =  809  =  beginning  of  trend  line,  at  1921 

Value  assignable  to  last  year,  four  years  forward  from  middle — 
1,653  +  4  X  210.97  =  2,497  =  end  of  trend  line,  at  1929 

sent  the  trend  by  a  straight  line,  but  ordinarily  this  is  not  neces- 
sary. Visual  inspection  is  probably  just  as  good,  if  carefully 
done.     Especially  after  computing  and  plotting  a  trend  line  on 
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the  chart  with  the  original  data,  the  adequacy  of  the  line  may  be 
judged  by  eye. 

A  common  type  of  time  series  is  illustrated  by  the  sales  figures 
in  Table  I.  The  figures  in  the  first  column  represent  the  sales 
of  a  company  in  each  of  nine  consecutive  years.  It  is  to  be 
assumed  that  these  figures  have  already  been  plotted  on  graph 
paper  and  that  a  straight-line  trend  is  indicated. 

The  steps  in  the  calculation  of  a  trend  line  are  explained  by  the 
column  headings  in  the  table  and  the  notations  below  it.  Points 
for  plotting  the  trend  line  are  given  for  the  three  years,  1921, 
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1921        1922        1923 
-Straight-line  trend. 


1924        1925        1926        1927        1928       1929 
(Time  intervals  uniform  in  length  and  odd  in 
number.) 


1925,  and  1929.  Intermediate  points  can  easily  be  interpolated, 
if  they  are  needed.  By  drawing  in  this  trend  line  on  the  chart  it 
will  be  seen  to  fit  the  original  data.  Figure  63  shows  the  origi- 
nally plotted  points  and  the  computed  trend  line  running  through 
them. 

It  is  to  be  noted  that  the  series  in  Table  I  contains  an  odd 
number  of  years,  that  is,  there  actually  is  a  middle  year.  When 
the  series  contains  an  even  number  of  years,  the  middle  point  is 
halfway  between  the  two  mid-most  years.  That  necessitates 
one  slight  change  in  method;  namely,  tabulating  the  distances 
from  the  middle  point  in  half-years  instead  of  years.  All  other 
steps  remain  unchanged,  except  that  the  numbers  in  the  resulting 
calculations  are  larger.  The  addition  of  the  year  1930  to  the 
foregoing  sales  figures  makes  the  series  look  as  shown  in  Table 
II.  The  column  headings  and  the  calculations  below  the  table 
explain  the  method  of  computing  the  trend  line. 
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Table  II. — Straight-line  Trend 
(Time  intervals  uniform  in  length  and  even  in  number) 


1 

2 

3 

4 

Year 

Sales  in 

thousands  of 

dollars 

Distance  from 
middle  point 

Column  1 

multiplied  by 

column  2 

Squares  of 
figures  in 
column  2 

1921 

756 

-9 

-  6,804 

81 

1922 

1,052 

-7 

-  7,364 

49 

1923 

1,319 

-5 

-  6,595 

25 

1924 

1,401 

-3 

-  4,203 

9 

1925 

1,649 

-1 

-   1,649 

1 

-26,615 

1926 

1,892 

+1 

+  1,892 

1 

1927 

2,006 

+3 

+  6,018 

9 

1928 

2,243 

+5 

+11,215 

25 

1929 

2,561 

+7 

+  17,927 

49 

1930 

2,605 

+9 

+23,445 

81 

+60,497 

Totals 

17,484 

0 

+33,882 

330 

17,484  =  1,748  =  middle  point  of  trend  line,  halfway  between  1925  and  1926 
33,882  =  102.67  =  increase  per  half-year. 


330 


1,748  -  9  X  102.67  =  824  =  beginning  of  trend  line,  at  1921 
1,748  +  9  X.  102.67  =  2,672  =  end  of  trend  line,  at  1930 


As  shown  by  the  resulting  trend  figures,  the  addition  of  1930 
to  the  series  has  made  the  slope  of  the  trend  line  slightly  less  steep, 
because  the  actual  increase  in  that  year  was  much  less  than 
normal.     The  result  is  shown  in  Fig.  64. 

In  the  two  examples  given  in  Table  I  and  Table  II,  the  units 
of  time  interval  are  uniform  in  length,  for  each  unit  is. exactly 
one  year,  and  no  years  are  omitted.  In  certain  other  cases  the 
time  intervals  will  not  be  uniform,  and  the  foregoing  method 
cannot  be  used.  In  such  cases,  the  data  plotted  on  a  chart  will 
show  irregularity  in  the  progression  of  the  x  values,  or  abscissas, 
as  referred  to  the  horizontal  base  of  the  chart. 
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This  would  occur  in  the  foregoing  examples  if  the  sales  figures 
for  some  of  the  years  were  missing.  There  would  then  be  gaps 
in  the  series  and  the  above  method  would  not  work  at  all.  This 
difficulty  can  be  overcome,  however,  for  there  is  a  more  general 
method  which  does  not  require  uniform  time  intervals. 

If  we  have  a  long  series  and  only  one  or  two  items  are  missing 
it  may  be  permissible  to  bridge  the  gaps  by  inserting  in  each  a 
hypothetical  figure  equal  to  the  mean  of  the  two  adjacent  items. 
This  saves  time  in  computation  but  is  not  strictly  correct,  because 
it  gives  too  much  weight  to  the  two  items  which  happen  to  be 
adj  acent  to  the  gap.  The  correct  method  will  be  shown  presently. 
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Fig.  64.— Straight-line  trend.      (Time  intervals  uniform  in  length,  and  even  in 

number.) 

In  certain  types  of  time  series,  irregularity  of  time  interval  is 
the  rule  rather  than  the  exception.  An  example  is  a  series  result- 
ing from  combining  measurements  reported  by  various  investiga- 
tors at  different  times.  Let  us  assume,  for  instance,  that  a 
number  of  surveys  have  been  made  of  bathtub  installations  in 
farmhouses.  These  surveys  were  made  by  different  people  at 
irregular  intervals  in  the  past  twenty  years,  most  of  them  occur- 
ring in  the  last  eight  years.  The  problem  is  to  determine  the 
secular  trend. 

In  plotting  the  data,  a  uniform  scale  of  years  is  marked  along 
the  x  axis  of  the  chart.  At  each  year  for  which  we  have  data, 
the  y  distance  is  measured  up  from  the  axis  and  a  point  in  the 
graph  is  established.  By  inspecting  the  points  on  this  imaginary 
chart,  it  is  seen  that  a  straight  line  can  represent  the  trend.  The 
method  of  solution  is  explained  by  the  column  headings  and  foot- 
ings in  Table  III  and  the  calculations  following  the  table.  Fig- 
ure 65  shows  the  plotted  points  and  the  computed  trend  line. 
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Table  III. — Straight-line  Trend 
(Time  intervals  irregular) 


1 

2 

3 

4 

(Hypothetical 
data)  Bath- 

Distance  from 

Column  1 

Squares  of 

Year 

starting  point 

multiplied  by 

figures  in 

(000  omitted) 

(1915) 

column  2 

column  2 

1915 

185 

0 

0 

0 

1920 

327 

5 

1,635 

25 

1923 

361 

8 

,2,888 

64 

1927 

448 

12 

5,376 

144 

1928 

492 

13 

6,396 

169 

1930 

519 

15 

7,785 

225 

1932 

535 

17 

9,095 

289 

1935 

568 

20 

11,360 

400 

Totals 

3,435 

90 

44,535 

1,316 

2(2/) 

2  (x) 

X(xy) 

Z(aj») 

Algebraic 

symbols 

n  =  8,  or  the  number  of  figures  in  each  of  the  above  columns 

The  above  totals  are  to  be  substituted  for  the  corresponding  algebraic 
symbols  in  the  following  two  equations,  which  have  been  developed  from 
the  "method  of  least  squares." 

(1)  Z(y)  =  rca  +  62(z) 

(2)  X(xy)  =  flSW  +  62(z2) 

Since  the  table  gives  the  values  for  n,  2(y),  2 (a),  ?(xy),  and  2(z2),  the 
corresponding  figures  are  substituted  for  them  in  the  above  two  equations, 
which  then  become 

(1)  3,435  =  8a  +  906 

(2)  44,535  =  90a  +  1,3166 

which  are  to  be  solved  for  the  values  of  a  and  6.      ^ 

First,  each  equation  is  multiplied  by  the  coefficient  of  a  in  the  other 
equation.  In  other  words,  equation  (1)  is  multiplied  by  90,  which  is  the 
coefficient  of  a  in  equation  (2) ;  and  equation  (2)  is  multiplied  by  8,  which  is 
the  coefficient  of  a  in  equation  (1). 

(1)  X  90  309,150  =  720a  +  8,1006 

(2)  X    8  356,280  =  720a  +  10,5286 


Subtracting  (1)  from  (2), 
Solving, 


47,130 
6 


2,4286 
47,130 
2,428 


=  19.415 
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Substituting  this  value  for  b  in  equation  (1), 

3,435  =  8a  +  1,747.35 

a  =  3,435  -  1,747.35  =  mMe 

8 

The  entire  computation  up  to  this  point  was  for  the  purpose  of  determining 
the  values  of  a  and  b,  which  are 


a  =  210.956 


19.415 


These  values  are  to  be  substituted  in  the  general  equation  which  represents 
any  straight  line,  which  is 

y  =  a  +  bx 
Substituting  for  a  and  b,         y  =  210.956  +  19.415a; 
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Fig.  65. — Straight-line  trend.      (Time  intervals  irregular.) 

which  is  the  algebraic  equation  for  the  trend  line  of  the  original  data,  x 
represents  the  horizontal  distance  from  the  starting  point,  or  the  number  of 
years  from  1915.  y  represents  the  vertical  height  from  zero,  or  the  number 
of  bathtubs,  expressed  in  thousands. 

This  equation  will  give  the  location  of  any  point  on  the  trend  line.  In 
order  to  draw  the  line  on  the  chart,  only  two  points  need  be  located.  Any 
two  points  will  do,  but  it  is  best  to  locate  the  two  extremities,  at  least. 
Accordingly,  the  values  of  x  corresponding  to  1915  and  1935  are  substituted 
in  the  trend-line  equation,  as  follows: 


210.956  +  19.415  X  0  = 
210.956  +  19.415  X  20 


210.956 
=  599.256 


1915  (x  =  0)  y 

1935  (x  =  20)         y 

After  establishing  these  two  points  for  1915  and  1935,  the  line  can  be  drawn, 
and  it  will  fit  the  data  satisfactorily,  at  least  for  ordinary  purposes. 


Now  we  come  to  the  consideration  of  data  in  which  the  secular 
trend   cannot   truly  be   represented  by   a   straight   line.     The 
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existence  of  a  curved  trend  is  indicated  by  the  points  plotted  on 
ordinary  graph  paper.  There  are  many  different  types  of  trend 
curves,  and  they  cannot  be  fully  discussed  here.  It  is  important 
to  mention  the  two  most  common  types,  however,  for  they  would 
apply  in  a  great  majority  of  the  cases  arising  in  marketing 
research.  They  are  known,  respectively,  as  the  exponential  and 
parabolic  curves. 

An  exponential  curve  depicts  a  continuous  growth  or  decline 
with  a  constant  percentage  change  in  each  unit  of  time.  For 
example,  if  $1,000  is  deposited  at  compound  interest  in  a  savings 
bank,  the  growth  of  principal  would  be  an  exponential  curve. 
The  sales  of  a  company,  increasing  10  per  cent  every  year,  would 
be  represented  by  an  exponential  curve. 

The  best  way  to  tell  whether  a  trend  has  this  form  of  curve  is 
to  plot  the  data  on  semilogarithmic  paper.  On  this  paper,  the 
horizontal  scale,  or  the  x  axis,  is  marked  in  the  ordinary  way  with 
uniform  spaces,  while  the  vertical  scale,  or  the  y  axis,  is  spaced 
with  distances  representing  the  logarithms  of  the  y  values  instead 
of  the  numbers  themselves.  The  y  distances  are  marked  with 
ordinary  numbers  however,  instead  of  logarithms,  which  makes 
it  easy  to  plot  the  points. 

After  plotting  the  data  on  this  semilogarithmic  graph  paper,  if 
a  straight  line  seems  to  be  indicated  by  the  points  the  series  is 
an  exponential  one.  In  other  words,  the  data  show  an  approxi- 
mately uniform  percentage  growth  or  decline.  When  this  is 
established,  the  solution  is  not  a  great  deal  more  difficult  than  the 
solution  of  a  straight-line  trend  in  original  data. 

As  stated  in  connection  with  the  preceding  example  of  bathtub 
installations  in  farmhouses,  the  equation  for  any  straight  line  is 

y  =  a  -f-  bx 

The  equation  for  an  exponential  curve,  on  the  other  hand,  is 

log  y  =  a  +  bx 

This  must  obviously  be  true  when  the  data  plotted  on  semi- 
logarithmic paper  result  in  a  straight  line,  for  in  so  plotting  the 
points  we  have  in  reality  plotted  the  logarithms  of  y  instead  of 

V  Involving  such  a  curve,  the  first  step  is  to  look  up  the  logarithms 
of  all  the  y  values.     Then  the  solution  proceeds  exactly  as  in  the 
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case  of  a  straight-line  trend,  except  that  the  logarithms  are  used 
in  place  of  the  y  values. 

To  be  specific,  we  may  consider  the  three  examples  of  straight- 
line  trend  given  in  Tables  I,  II,  and  III.  If  the  data  in  these 
cases  were  of  the  exponential  type,  we  would  simply  throw  out 
Column  1  from  each  table,  and  substitute  the  logarithms  of  those 
numbers  in  place  of  the  numbers  themselves.  After  this  sub- 
stitution, the  method  of  computation  is  exactly  the  same  as 
before,  until  the  final  point  where  the  equation  of  the  trend  line 
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Fig.  66. — Curved-line  trend.      (Second-degree  parabola.) 

is  stated.  In  this  final  equation,  we  simply  substitute  the  term 
log  y  in  the  place  of  y. 

Then,  in  computing  the  points  on  the  trend  line,  the  regular 
computations  give  us  the  logarithms  of  y  instead  of  the  y  values 
directly.  In  conclusion,  the  antilogs  are  looked  up,  and  the 
actual  y  values  may  be  plotted  on  ordinary  rectangular  graph 
paper,  where  a  smooth  curve  will  result,  running  through  the 
original  plotted  data. 

The  parabolic  curve,  as  generally  understood,  appears  as  a 
parabola  of  the  second  degree.  An  example  of  such  a  curve  is 
given  in  Table  IV.     The  general  equation  for  this  type  of  curve  is 


y  =  a  +  bx  -f-  ex2 
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In  the  second  column  of  Table  IV,  x  represents  the  time  in 
years,  measured  from  the  reference  point,  and  in  the  first  column, 
y  represents  the  number  of  retail  outlets  selling  a  certain  com- 
pany's product.  The  column  headings  and  footings,  together 
with  the  computations  following  the  table,  explain  the  method 
of  calculating  points  on  the  trend  line.  Figure  66  illustrates 
the  data  as  originally  plotted,  together  with  the  curved  trend 
line  as  developed  in  the  computation. 

Table   IV. — Cubved-line  Tbend 
(Second-degree  parabola) 


1 

2 

3 

4 

5         i 

6 

Year 

Distance 

Column  1 

Squares 

Column  2 

Squares 

Number 
of  retail 

from 
middle 

multiplied 
by 

of  figures 
in 

multiplied 
by 

of  figures 
in 

outlets 

year 

column  2 

column  2 

column  3 

column  4 

1914 

65 

-7 

-       455 

49 

3,185 

2,401 

1915 

87 

-6 

-       522 

36 

3,132 

1,296 

1916 

96 

-5 

-       480 

25 

2,400 

625 

1917 

111 

-4 

-       444 

16 

1,776 

256 

1918 

124 

-3 

-       372 

9 

1,116 

81 

1919 

153 

-2 

-       306 

4 

612 

16 

1920 

157 

-1 

-       157 

1 

157 

1 

-  2,736 

1921 

185 

0 

0 

0 

0 

0 

1922 

222 

+1 

+       222 

1 

222 

1 

1923 

238 

+2 

+       476 

4 

952 

16 

1924 

276 

+3 

+       828 

9 

2,484 

81 

1925 

365 

+4 

+  1,460 

16 

5,840 

256 

1926 

357 

+5 

+  1,785 

25 

8,925 

625 

1927 

422 

+6 

+  2,532 

36 

15,192 

1,296 

1928 

463 

+7 

+  3,241 

49 

22,687 

2,401 

+10,544 

Totals 

3,321 

0 

+  7,808 

280 

68,680 

9,352 

2(2/) 

2(z) 

X(xy) 

X&) 

2(x2y) 

2(z4) 

Algebraic 
symbols 

- 

n  =  15,  o 

r  the  num 

oer  of  figui 

*es  in  each 

of  the  abo 

ve  columns 
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The  above  totals  are  to  be  substituted  for  the  corresponding  algebraic 
symbols  in  the  following  three  equations: 

S(y)  =na  +  c2(x2)  (1) 

X(xy)  =  &2(z2)  (2) 

2  (x2y)  =  aS(x2)  +  cS(a;4)  (3) 

Since  the  table  gives  the  values  for  n,  2(y),  X(x),  2(xy),  SO2),  2(z2?/), 
and  2(z4),  the  corresponding  figures  are  substituted  for  them  in  the  above 
three  equations,  which  then  become 

3,321  =  15a  +  280c  (1) 

7,808  =  2806  (2) 

68,680  =  280a  +  9,352c  (3) 

which  are  to  be  solved  for  the  values  of  a,  6,  and  c. 

First,  we  see  that  equation  (2)  can  be  solved  directly  for  the  value  of  b,  as 
it  contains  no  other  unknown.     Solving  (2), 

b  -  H8  = 27-886 

Next,  we  solve  equations  (1)  and  (3)  simultaneously,  first  multiplying  each 
of  these  two  equations  by  the  coefficient  of  a  in  the  other  equation.  In 
other  words,  equation  (1)  is  multiplied  by  280,  which  is  the  coefficient  of  a 
in  equation  (3);  and  equation  (3)  is  multiplied  by  15,  which  is  the  coefficient 
of  a  in  equation  (1). 

(1)  X  280  929,880  =  4,200a  +  78,400c 

(3)  X     15         1,030,200  =  4,200a  +  140,280c 

Subtracting  (1)  from  (3),        100,320  =  61,880c 

100,320       1  ft01 
Solving,  c  =  -^0    =  L621 

Substituting  this  value  for  c  in  equation  (1), 

3,321  =  15a  +  453.88 

a  =  3,321  -  453.88  =  m  Ul 
15 

The  entire  computation  up  to  this  point  was  for  the  purpose  of  determining 
the  values  of  a,  b,  and  c,  which  are 

a  =  191.141 
b  =  27.886 
c  =  1.621 

These  values  are  to  be  substituted  in  the  general  equation  of  a  second-degree 
parabola,  which  is 

y  =  a  +  bx  +  ex2 
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Substituting  for  a,  b,  and  c, 

y  =  191.141  +  27.886a;  +  1.621x2 

which  is  the  algebraic  equation  for  the  curved  trend  line  of  the  original  data. 
x  represents  the  horizontal  distance  from  the  selected  reference  point,  1921, 
the  number  of  years  back  being  considered  as  minus  and  the  number  of  years 
forward  being  considered  as  plus,  y  represents  the  vertical  height  from 
zero,  or  the  number  of  retail  outlets. 

This  equation  will  give  the  location  of  every  point  on  the  trend  line.  In 
order  to  draw  the  line  on  the  chart,  it  is  necessary  to  locate  a  point  for  each 
year  in  the  series,  because  the  line  is  curved.  Accordingly,  the  serial  values 
of  x  are  substituted  in  the  above  equation,  and  the  value  of  y  is  computed 
for  each  of  the  fifteen  years. 

For  1914,  for  instance,  the  value  of  x  is  minus  7,  which  is  substituted  in  the 
trend  equation,  which  becomes 

(1914)         y  =  191.141  -  27.886  X  7  +  1.621  X  49  =  75.368 
In  the  middle  year,  1921,  x  is  equal  to  zero,  and  the  equation  is  reduced  to 

(1921)         y  =  191.141 
In  the  last  year  of  the  series,  1928,  x  is  plus  7,  and  the  equation  is 

(1928)         y  =  191.141  +  27.886  X  7  +  1-621  X  49  =  465.772 

The  y  values  for  all  the  intermediate  years  are  found  in  similar  manner. 
Plotting  and  connecting  the  points,  a  smooth  curve  results,  fitting  the 
original  data  satisfactorily. 

Seasonal  Variations.  Time  series  representing  marketing  data 
usually  have  seasonal  characteristics.  The  existence  of  rhythmic 
seasonal  fluctuations  is  revealed  in  plotting  the  data  con- 
secutively by  months,  through  the  entire  series.  It  is  often 
necessary  to  compute  an  index  of  normal  seasonal  variation. 

Suppose  we  have  a  thirty-year  record,  by  months,  showing  the 
number  of  fares  collected  on  the  streetcars  of  a  certain  city.  The 
figures  reveal  a  tendency  for  streetcar  traffic  to  be  consistently 
heavier  in  some  months  than  in  others.  A  definite  seasonal 
influence  is  easily  seen,  although  there  are  many  other  fluctua- 
tions in  the  volume  of  traffic  due  to  weather,  business  activity, 
special  amusement  attractions,  etc. 

Let  us  say  that  the  street  railway  company  six  months  ago  put 
into  effect  a  reduced  fare  in  the  form  of  a  ten-ride  ticket.  The 
number  of  passengers  has  apparently  increased,  but  it  is  impor- 
tant to  know  definitely  how  much  the  volume  of  traffic  has  been 
raised  above  the  previous  normal.     This  can  be  determined  only 
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after  we  know  what  variations  are  due  to  purely  normal  seasonal 
influences.  This  is  learned  by  computing  an  index  of  seasonal 
variation. 

There  are  a  number  of  ways  in  which  a  seasonal  index  may  be 
computed,  some  very  simple  and  some  very  complicated.  The 
easiest  way  is  to  add  all  the  January  figures  together  and  obtain 
their  average;  then  find  the  average  for  all  the  Februarys;  and  so 
on  for  each  of  the  twelve  months.  Then  the  average  of  these 
twelve  averages  will  represent  the  hypothetical  standard  month. 
Using  this  figure  as  a  base,  each  of  the  twelve  monthly  averages 
is  then  divided  by  this  standard  month.     The  resulting  quotients 

Table  V. — Magazine  Advertising 
(Unit  =  1,000  agate  lines) 


December, 
1922  =  1,861 


January . . , 
February . 
March 

April 

May 

June 

July 

August 
September 
October . .  . 
November 
December . 


1923 


1,457 
1,762 
2,011 
2,309 
2,220 
2,046 
1,694 
1,477 
1,753 
2,229 
2,218 
2,044 


1924 


1,565 
1,906 
2,172 
2,476 
2,401 
2,202 
1,650 
1,404 
1,796 
2,195 
2,194 
2,084 


1925 


1,598 
2,038 
2,297 
2,505 
2,461 
2,308 
1,744 
1,553 
2,062 
2,504 
2,660 
2,407 


1926 


1,836 
2,321 
2,589 
2,856 
2,803 
2,663 
2,024 
1,866 
2,259 
2,815 
2,955 
2,652 


1927 


2,057 
2,455 

2,685 
2,944 
3,078 
2,588 
2,064 
1,887 
2,279 
2,777 
2,921 
2,575 


1928 


1,964 
2,283 
2,603 
3,080 
2,954 
2,602 
2,171 
1,770 
2,287 
2,916 
2,877 
2,622 


1929 


2,118 
2,488 
2,870 
3,171 
3,113 
2,884 
2,344 
1,959 
2,536 
3,050 
3,103 
2,396 


are  expressed  as  percentages  and  represent  the  twelve  monthly 
index  numbers.  When  there  are  no  clear  secular  trend,  no 
pronounced  cycles,  and  no  extreme  accidental  fluctuations,  this 
simple  method  is  satisfactory,  especially  with  fairly  long  series. 
With  suitable  corrections,  the  method  is  also  applicable  to  cases 
showing  definite  secular  trend.  The  corrections  may  be  applied 
in  the  same  manner  as  in  the  link  relative  method,  shown  in 
Table  VII  and  the  accompanying  explanatory  text. 

For  a  clear  understanding  of  the  difference  in  degree  of  refine- 
ment obtained  by  a  method  like  the  above  as  compared  with  a 
more  precise  method,  the  beginner  in  statistics  should  solve 
several  actual  problems  by  various  methods,  including  the  above, 
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and  note  the  amount  of  variation  in  results.  Such  practice 
has  more  instructional  value  than  any  amount  of  textbook 
explanation. 

Probably  the  most  universally  applicable  and  practical  method 
for  determining  seasonal  variation  is  the  method  of  link  relatives. 

As  an  example,  we  shall  calculate  the  seasonal  influence  on 
volume  of  magazine  advertising  during  the  seven-year  period, 
1923-1929,  inclusive.  The  figures  in  Table  V  give  the  advertising 
linage  as  measured  in  a  certain  list  of  leading  magazines. 

The  first  step  in  the  computation  is  to  obtain  the  link  relative 
for  each  month  in  the  seven  years,  or  84  in  all.  The  link  relative 
for  a  given  month  is  the  quotient  of  the  figure  on  advertising 
volume  for  that  month  divided  by  the  figure  for  the  immediately 
preceding  month.     Thus: 

Link  relative  for: 


January,  1923 
February,  1923 
March,  1923 


January,  1923    __  1,457 


December,  1922 
February,  1923 

January,  1923 

March,  1923 
February,  1923         1,762 


=  78.3  per  cent 


1,861 

1  762 

y^  =  120.9  per  cent 

=  114.1  per  cent 


After  thus  computing  the  eighty-four  monthly  link  relatives, 
they  are  tabulated  as  shown  in  Table  VI,  dropping  the  per  cent 
sign. 

Table  VI. — Link  Relatives  for  Magazine  Advertising 


Months 

1923 

1924 

1925 

1926 

1927 

1928 

1929 

Median 

January 

78.3 

76.6 

76.7 

76.3 

77.6 

76.3 

80.8 

76.7 

February .... 

120.9 

121.8 

127.5 

126.4 

119.3 

116.2 

117.5 

120.9 

March 

114.1 

114.0 

112.7 

111.5 

109.3 

114.0 

115.4 

114.0 

April 

114.8 

114.0 

109.1 

110.3 

109.6 

118.3 

110.5 

110.5 

May 

96.1 

97.0 

98.2 

98.1 

104.6 

95.9 

98.2 

98.1 

June 

92.2 

82.8 
87.2 

91.7 
74.9 
85.1 

93.8 
75.6 
89.0 

95.0 
76.0 
92.2 

84.1 
79.8 
91.4 

88.1 
83.4 
81.5 

92.6 
81.3 
83.6 

92.2 

July 

79.8 

August ....... 

87.2 

September .  .  . 

118.7 

127.9 

132.8 

121.1 

120.8 

129.2 

129.5 

127.9 

October 

127.1 

122.2 

121.4 

124.6 

121.9 

127.5 

120.3 

122.2 

November .  .  . 

99.5 

100.0 

106.2 

105.0 

105.2 

98.7 

101.7 

101.7 

December 

92.2 

95.0 

90.5 

89.7 

88.2 

91.1 

93.3 

91.1 
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In  the  last  column  of  Table  VI  is  given  the  median  of  the  seven 
link  relatives  for  each  month,  reading  across  the  table  from  left 
to  right  on  each  line.  As  explained  in  a  previous  section,  the 
median  is  the  middle  value  of  a  series.  Thus,  of  the  seven 
Januarys,  the  median  is  76.7,  and  it  happens,  to  occur  in  1925. 
Of  the  other  six  Januarys,  three  are  larger  and  three  are  smaller 
than  76.7. 

Each  of  the  twelve  median  link  relatives  represents  a  percentage 
based  on  the  immediately  preceding  month.  It  is  necessary  to 
convert  these  percentages  so  they  will  refer  to  a  constant  base. 
When  this  has  been  done,  the  new  percentages  are  termed  chain 
relatives.  For  convenience,  January  is  chosen  as  the  base.  Con- 
sequently, the  chain  relative  for  January  is  100.  Since  February 
is  120.9  per  cent  of  January,  the  February  chain  relative  remains 
at  120.9.  But  since  March  is  114  per  cent  of  February,  the 
March  chain  relative,  with  January  as  the  base,  is  1.140  X  120.9, 
or  137.8.  The  chain  relative  for  April  is  1.105  X  137.8,  or  152.3. 
Proceeding  similarly  with  the  rest  of  the  twelve  months,  the 
following  chain  relatives  are  obtained: 

Chain  Relatives 

January 100.0  July 109.9 

February 120 . 9  August 95 . 8 

March 137.8  September 122.5 

April 152.3  October 149.7 

May 149.4  November 152.2 

June 137.7  December 138.7 

This  does  not  finish  the  matter,  however.  In  the  table  of  link 
relatives,  the  January  median  was  shown  as  76.7.  This  means 
that  it  is  typical  for  January  magazine  advertising  volume  to  be 
76.7  per  cent  of  the  preceding  December  volume.  In  the  above 
chain  relatives,  December  volume  is  represented  by  the  figure, 
138.7.  The  January  volume  might  then  be  expected  to  be 
.767  X  138.7,  or  106.4.  However,  the  above  table  of  chain  rela- 
tives starts  out  with  the  assumption  that  January  is  100.  Thus 
there  is  a  discrepancy  of  6.4.  This  is  due  to  the  annual  increase 
in  advertising  volume  during  the  seven-year  period  covered  by 
the  data.  Since  a  purely  seasonal  index  is  desired,  uninfluenced 
by  longer  cycles  and  trends,  the  chain  relatives  must  be  corrected 
to  eliminate  the  6.4  rise  from  one  January  to  the  next  January. 
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The  simplest  way  to  make  this  correction  is  to  distribute  it 
evenly  over  the  twelve  months,  which  is  sufficiently  accurate  for 
most  cases.  In  other  words,  K2  X  6.4  is  subtracted  from  the 
February  chain  relative,  %2  X  6.4  is  subtracted  from  March, 
%2  X  6.4  from  April,  etc.     The  result  is  shown  in  Table  VII. 


Table  VII.- — Seasonal  Vabiation  in  Magazine  Advertising,  1923-1929 


Months 


January . . . 
February . . 

March 

April 

May 

June 

July , 

August .  . . 
September 
October . . . 
November 
December 

Average . . 


Chain 
relatives 


100.0 
120.9 
137.8 
152.3 
149.4 
137.7 
109.9 
95.8 
122.5 
149.7 
152.2 
138.7 


Correction 


4.3 

■4.8 
■5.3 
■5.9 


Corrected 

chain 
relatives 


100.0 
120.4 
136.7 
150.7 
147.3 
135.0 
106.7 
92.1 
118.2 
144.9 
146.9 
132.8 


1,531.7 


Index  of 
seasonal 
variation 


78.3 

94.3 

107.1 

118.1 

115.4 

105.8 

83.6 

72.2 

92.6 

113.5 

115.1 

104.0 


127.64 


1,200.0 


100.0 


The  corrected  chain  relatives,  as  shown  in  the  third  column  of 
Table  VII  give  a  true  index  of  monthly  variations,  but  they  are  not 
in  the  most  practicable  form,  as  the  monthly  percentages  are  all 
based  on  January  as  100.  For  practical  use,  these  figures  should 
all  be  converted  to  the  average  month  as  a  base.  This  is  done  by 
dividing  each  monthly  figure  by  127.64  per  cent,  which  is  the 
average  for  the  twelve  months.  The  resulting  final  index  of 
seasonal  variation  is  shown  in  the  last  column  of  the  table,  with 
an  average  of  100. 

A  more  precise  method  for  computing  the  corrections  to  be 
applied  to  the  chain  relatives  would  be  to  calculate  each  correction 
by  use  of  the  compound-interest  formula.  Although  this  method 
is  more  nearly  correct  theoretically,  it  need  not  be  used  here, 
because  the  difference  in  results  would  hardly  be  noticeable,  and 
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the  original  data  are  not  sufficiently  accurate  to  warrant  such  a 
refinement. 

In  most  cases,  the  purpose  in  computing  indexes  of  seasonal 
variation  is  to  remove  the  seasonal  influence  from  the  original 
data.  In  our  present  example,  the  actual  monthly  linage  figures 
are  to  be  modified  in  such  a  way  that  the  revised  figures  will 
record  the  fluctuations  and  trend  in  magazine  linage  as  they 
would  occur  without  the  influence  of  purely  seasonal  factors. 
This  is  known  as  correcting  for  seasonal  variation. 

The  index  of  seasonal  variation  has  already  been  computed,  and 
the  series  of  twelve  monthly  figures  comprising  this  index  are 
shown  in  Table  VII.  The  original  data  on  volume  of  magazine 
linage  were  given  in  Table  V.  The  seasonal  correction  is  made  by 
dividing  each  monthly  figure  in  the  original  data  by  the  cor- 
responding monthly  figure  from  the  index.  In  other  words,  all 
the  Januarys  are  divided  by  78.3  per  cent,  all  the  Februarys  by 
94.3  per  cent,  etc.     (Index  figures  are  considered  as  percentages.) 


Table  VIII. — Magazine  Advertising,  Corrected  for  Seasonal 

Variation 
(Unit:  1,000  agate  lines) 


Month 


January . . , 
February . 

March 

April 

May 

June 

July 

August 
September 
October.  .  . 
November 
December. 


1923 


1,861 
1,869 
1,878 
1,955 
1,924 
1,934 
2,026 
2,046 
1,893 
1,964 
1,927 
1,965 


1924 


1,999 
2,021 
2,028 
2,097 
2,081 
2,081 
1,974 
1,945 
1,940 
1,934 
1,907 
2,004 


1925 


2,041 
2,161 
2,145 
2,121 
2,133 
2,181 
2,086 
2,151 
2,227 
2,206 
2,311 
2,314 


1926 


2,345 
2,461 
2,417 
2,418 
2,429 
2,517 
2,421 
2,584 
2,440 
2,480 
2,567 
2,550 


1927 


2,627 
2,603 
2,507 
2,493 
2,667 
2,446 
2,469 
2,614 
2,461 
2,447 
2,538 
2,476 


1928 


2,508 
2,421 
2,430 
2,608 
2,560 
2,459 
2,597 
2,452 
2,470 
2,569 
2,500 
2,521 


1929 


2,705 
2,638 
2,680 
2,685 
698 
726 
804 
713 
.739 
2,687 
2,696 
2,785 


The  final  result  is  shown  in  Table  VIII.  We  now  have  a  record 
of  magazine  advertising  volume  over  the  period  of  seven  years, 
corrected  for  seasonal  variation.  Theoretically,  each  figure  in 
the  table  represents  the  volume  of  magazine  linage  which  would 
have  occurred  in  a  particular  month,  if  there  had  been  no  factors 
causing  regularly  recurring  seasonal  fluctuations. 
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The  graph  in  Fig.  68,  represents  the  course  of  advertising 
volume,  corrected  for  seasonal  variation.  It  is  to  be  compared 
with  the  more  jagged  line  in  Fig.  67,  which  represents  the  original 
data  before  removing  the  seasonal  factor. 


FIG.  67. — Magazine  advertising,  uncorrected  monthly  data. 


1923  1924       I        1925  1926  1927  1928  _ 

Fig.  68.— Magazine  advertising,  corrected  for  seasonal  variation. 

In  certain  cases,  the  method  of  moving  averages  will  be  found  to 
be  a  convenient  device  for  eliminating  seasonal  variations  from 
time  series.     Although  the  computations  are  quite  simple,  this 
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method  must  be  used  with  great  care  to  avoid  erroneous  results, 
and  it  will  not  be  described  here. 

The  physical  factors  causing  seasonal  variations  will  sometimes 
be  found  to  shift,  over  a  period  of  time,  due  to  changes  in  the 
underlying  forces.  There  are  various  ways  for  handling  such 
cases  of  shifting  seasonals.  Each  case  must  be  studied  thoroughly 
before  determining  upon  a  method  for  final  analysis,  which 
ultimately  must  depend  upon  the  good  judgment  and  resourceful- 
ness of  the  analyst  himself. 

Other  Periodic  Cycles  and  Irregular  Fluctuations.  Cycles  are 
the  periodic  swings  above  and  below  normal,  as  distinguished  from 
the  irregular  fluctuations  found  in  practically  every  body  of  data, 
and  from  the  steady  secular  trend  and  the  annually  recurring 
seasonal  variations.  When  the  data  are  plotted  in  a  graph,  after 
correcting  the  figures  for  secular  trend  and  seasonal  variations, 
the  cycles,  if  any  are  present,   are  usually  plainly  visible  to 

the  eye. 

When  it  is  desired  to  produce  a  smooth  curve,  the  irregular 
fluctuations  may  sometimes  be  eliminated  by  arbitrary  corrections 
or  by  computing  moving  averages.  As  the  name  implies,  a  moving 
average  is  simply  the  average  of  three,  five,  twelve,  or  any  other 
number  of  consecutive  months  and  is  assigned  to  the  middle 
point  of  these  months,  a  new  average  being  calculated  for  each 
month  successively  taken  as  the  middle  point,  always  using  the 
same  number  of  consecutive  months  in  computing  the  average. 
The  important  thing  is  to  use  the  right  number  of  months  and 
this  can  be  decided  by  noting  the  character  of  the  curve  and  its 
fluctuations.  The  latter  might  be  compared  to  the  ripples  on  the 
surface  of  larger  waves  which  correspond  to  the  periodic  cycles. 
The  number  of  months  included  in  each  calculation  of  the  moving 
average  should  approximate  the  length  of  the  ripples. 

For  precise  statistical  analysis,  there  are  many  refined  methods 
for  smoothing  time  series,  but  the  ordinary  marketing  problem 
will  not  require  their  application. 

Correlations.  In  the  analysis  of  both  time  series  and  frequency 
distributions,  it  is  often  useful  to  compare  two  or  more  curves  and 
to  determine  how  nearly  they  correspond.  This  can  be  done 
mathematically,  expressing  the  degree  of  correspondence  by  an 
index  number  called  the  coefficient  of  correlation,  or  by  multiple 
correlation.     It  is  not  within  the  scope  of  this  discussion  to  describe 
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the  methods  of  computation,  although  any  adequate  treatment 
of  its  subject  really  ought  to  include  them. 

A  word  of  warning  is  in  order  here,  however,  as  to  the  inter- 
pretation of  correlations,  which  may  be  computed  according  to 
methods  ^described  in  standard  textbooks  on  statistics.  The  dis- 
covery that  there  is  marked  similarity  in  the  respective  variations 
of  two  given  factors  over  a  certain  period  of  time  may  be  very 
significant,  but  does  not  necessarily  prove  that  the  variations  in 
one  factor  cause  the  variations  in  the  other.  A  high  degree  of 
covariation  between  two  time  series  is  often  mistakenly  inter- 
preted to  mean  that  the  one  phenomenon  must  therefore  be  the 
cause  of  the  other,  when  in  fact  the  two  phenomena  may  simply 
be  influenced  by  a  third  factor  that  affects  them  both  to  the  same 
degree. 

Ridiculous  conclusions  may  sometimes  arise  from  such  mis- 
taken interpretations,  as  shown  by  the  following  rather  improb- 
able illustration.  In  studying  the  market  for  shoe-repairing 
service,  it  was  found  that  the  volume  of  shoe  repairs  showed  a 
high  correlation  with  the  number  of  telephone  removals.  The 
assumption  of  a  causal  relation  here  would  probably  mean  that 
former  telephone  subscribers  walk  farther  in  order  to  do  their 
telephoning  and  so  wear  out  their  shoe  soles  more  rapidly.  It 
might  even  be  shown  that  the  increase  in  shoe  repairs  is  particu- 
larly marked  among  these  former  telephone  subscribers.  This 
line  of  investigation  is  all  very  silly,  of  course,  for  common  sense 
indicates  that  shoe  repairs  and  telephone  removals  both  must  be 
the  result  of  reduced  income  on  the  part  of  people  who  con- 
sequently cannot  afford  either  telephones  or  new  shoes. 

The  point  is  that  a  great  deal  of  responsibility  rests  upon  the 
nonmathematical  reasoning  of  the  investigator.  No  amount  of 
statistical  correlation  can  sustain  an  unreasonable  assumption. 
It  may  be  added  that  even  in  the  most  clear-cut  case  of  known 
cause  and  effect,  the  mathematical  process  of  correlation  does  not 
of  itself  prove  the  existing  causal  relation,  but  shows  merely  how 
closely  the  trend  and  the  variations  in  one  set  of  data  correspond 
with  the  trend  and  variations  in  the  other.  This  correspondence 
has  great  significance,  of  course,  but  a  meaning  which  is  not  there 
should  not  be  read  into  it. 

Multiple  correlation  is  an  extremely  useful  device  which  opens 
up  an  entire  field  of  statistical  reasoning.     But  here,  again,  it  is 
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necessary  to  guard  against  categorical  interpretation.  The 
numerical  conclusions  do  not  actually  measure  physical  causes, 
but  merely  comparative  degrees  of  correspondence  in  the  recorded 
data,  which  admittedly  do  throw  light  on  the  study  of  factors 
believed  to  be  causes. 

In  most  marketing  problems,  it  is  not  necessary  to  have  an 
exact  mathematical  measurement  of  the  degree  of  correlation 
between  two  or  more  time  series,  and  for  these  cases  the  following 
simple  expedient  is  recommended:  The  various  time  series  are 
plotted  on  graph  paper,  each  on  a  separate  sheet.  The  dependent 
variable,  that  is,  the  time  series  which  is  presumed  to  be  influenced 
in  its  variations  by  one  or  more  factors,  is  plotted  on  heavy  paper, 
and  the  factors  whose  influence  is  being  studied  are  plotted  on 
transparent  sheets  of  plotting  paper.  By  placing  the  thin  sheets 
over  the  heavy  sheet,  one  at  a  time,  the  correspondence  of  the 
dependent  variable  with  each  of  the  factors  can  be  judged  by  eye. 
This  method  is  particularly  useful  in  observing  a  time-"lag," 
which  is  done  by  shifting  the  transparent  graph  paper  from  left 
to  right  until  the  curve  on  the  transparent  paper  corresponds  best 
with  the  curve  on  the  sheet  underneath. 

Even  simpler  than  this  is  the  very  common  method  of  plotting 
several  curves  on  the  same  sheet,  superimposed  upon  one  another, 
on  the  same  time-scale.  Inspection  by  eye  frequently  gives  all 
the  information  that  may  be  necessary. 

The  graphical  method  of  plotting  curves  for  comparison  is 
almost  indispensable  to  a  clear  grasp  of  a  situation.  Even  when 
correlations  are  to  be  computed  mathematically,  the  curves 
should  be  plotted  anyway,  if  only  for  the  purpose  of  obtaining  a 
visual  concept  of  their  relationship. 

A  basic  necessity  in  all  marketing  studies  is  that  the  investiga- 
tor "keep  his  feet  on  the  ground"  at  all  times,  understand  the 
practical  significance  of  every  step  in  his  analysis,  and  interpret 
every  mathematical  conclusion  in  terms  of  the  realistic  problem 
at  hand. 
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CHAPTER  XX 
PREDETERMINING  THE  SIZE  OF  A  SAMPLE1 

In  problems  of  market  research  the  question  often  is  asked, 
"How  many  items  must  there  be  in  the  sample? "  This  question 
cannot  be  answered  in  the  abstract.  Something  first  must  be 
known  regarding  the  extent  of  error  permitted  by  the  conditions 
of  the  problem.  Thus,  in  one  problem  a  certain  manufacturer 
may  be  entirely  satisfied  in  knowing  his  error  limits  within  10  per 
cent  either  way.  On  the  other  hand,  in  setting  premiums  in 
insurance  problems  it  is  necessary  to  estimate  the  pure  premium 
with  the  highest  possible  accuracy. 

The  question,  "How  many  items  are  necessary  in  a  sample?" 
consequently  must  be  deferred  until  the  question,  "How  accurate 
is  it  necessary  to  know  the  result?"  is  answered. 

When  once  the  accuracy  needed  by  a  given  problem  has  been 
determined,  then  it  is  perfectly  possible  on  the  basis  of  established 
formulas  to  give  the  number  of  items  in  a  random  sample  which 
will  be  necessary.     For  example :  , 

A  certain  corporation  manufacturing  playing  cards  was  con- 
sidering the  possibility  of  selling  by  mail.  A  number  of  mailing 
lists  were  available,  including  those  of  club  members  and  college 
graduates,  as  well  as  commercial  lists.  One  of  the  officers  of  the 
company  estimated  that  if  20  per  cent  of  the  names  represented 
bridge  players,  it  would  be  profitable  to  circularize  the  lists.  On 
the  other  hand,  it  was  estimated  that  the  proportion  of  bridge 
players  in  those  lists  might  possibly  be  30  per  cent. 

In  order  to  come  to  a  decision,  it  was  decided  to  check  these 
estimates  by  means  of  a  sample  questionnaire.  The  problem 
then  became  one  of  determining  the  number  of  questionnaires 
necessary. 

The  first  step  in  the  problem  was  to  decide  from  the  information 
given  what  percentage  of  error  would  be  permissible.     In  this 

1  Adapted  from  Brown,  Theodore  H.,  The  Use  of  Statistical  Techniques 
in  Certain  Problems  of  Market  Research  (Harvard  Business  School,  Division 
of  Research,  Business  Research  Studies,  No.  12),  pp.  10-13. 
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particular  case,  the  assumed  value  of  p  was  30  per  cent,  since  this 
was  the  most  probable  guess  made.  Apparently  the  corporation 
would  be  satisfied  even  if  20  per  cent  of  the  lists  in  hand  repre- 
sented bridge  players.  This  was  10  per  cent  less  than  the  30  per 
cent.  Consequently,  the  permissible  error  was  30  per  cent  less 
20  per  cent  or  10  per  cent.  Hence  S'd  =  10  per  cent.1  With 
reference  to  the  technical  approach  involved  in  the  solution  of  the 
problem,  the  formula  was 

\  n 

in  which  p  represents  the  proportion  of  favorable  occurrences,  q 
represents  the  proportion  of  unfavorable  occurrences  and  n  equals 
the  total  number  of  observations.  Three  standard  deviations, 
as  determined  from  this  formula,  were  used.  Consequently,  the 
following  values  would  hold : 

<f  =  3.33  per  cent 
p  =  30  per  cent 
q  =  70  per  cent 

Substituting  in  the  formula,  it  will  be  found  that  n  =  189. 

Suppose  200  replies  were  obtained.  If  62  of  these  were  bridge 
players  it  would  give  the  value  of  p  =  31  per  cent.  This  would 
agree  approximately  with  the  preliminary  estimate.  Since  by 
assumption  •3<f  =  10  per  cent,  the  manufacturer  could  be  prac- 
tically certain  that  at  least  20  per  cent  of  the  lists  would  represent 
bridge  players. 

The  original  estimate,  however,  may  be  quite  erroneous. 
Suppose,  for  example,  that  only  40  of  the  replies  were  from  bridge 
players.  This  would  make  p  =  20  per  cent.  Since  presumably 
the  manufacturer  had  good  reasons  for  believing  originally  that 
p  =  30  per  cent,  there  would  be  an  apparent  contradiction  which 
would  have  to  be  cleared  up.  The  original  estimate  may  be 
wrong  or  the  sample  taken  may  be  of  so  unusual  a  character  that 
it  distorts  the  result.  The  first  of  these  assumptions  seems  the 
more  reasonable,  since  three  standard  deviations  were  used  in 
determining  the  number  of  samples  to  be  taken.  On  the  other 
hand,  it  must  be  remembered  that  sometimes  unusual  events  do 
happen. 

i  if  =  the  standard  deviation  expressed  as  a  percentage. 
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If  it  is  assumed  that  the  original  estimate  of  30  per  cent  for  p 
is  in  error  and  that  the  value  of  20  per  cent  originally  should  have 
been  taken,  the  table  shows  that  in  place  of  189  items,  144  might 
have  been  satisfactory. 

A  second  element,  however,  was  present  in  the  problem,  which 
needs  further  consideration.  The  manufacturer  estimated  that 
he  would  need  at  least  20  per  cent  in  order  to  make  his  proposition 
commercially  satisfactory.  It  has  been  assumed,  however,  that 
the  margin  was  10  per  cent  either  way.  To  solve  this  difficulty, 
two  possibilities  are  available.  Both  of  these  are  based  upon 
the  necessity  of  determining  the  value  of  p  more  accurately. 

One  possible  approach  is  to  be  found  in  the  assumption  of 
20  per  cent  as  the  accurate  value  of  p,  with  the  limitation  that  the 
error  shall  not  be  more  than  2  per  cent  either  way.  Reference 
to  the  table,  which  will  later  be  described  and  presented  in  full, 
shows  that,  in  order  to  determine  definitely  the  value  of  p  with 
this  degree  of  accuracy,  the  sample  would  have  to  be  increased  to 
3,600  returns  actually  received.  If,  still  regarding  20  per  cent  as 
the  accurate  value  of  p,  more  exactitude  were  required  and  only 
1  per  cent  variation  could  be  allowed,  the  sample  would  have  to 
be  increased  to  14,400.  The  cost  might  make  such  a  number  of 
observations    prohibitive. 

A  second  possibility  is  that  of  assuming  that  the  value  of  p 

determined  from  the  small  sample  is  somewhat  unusual  and  that 

its  true  value  would  be  nearer  25  per  cent.     The  table  referred  to, 

25 
under  column  n  ■>  shows  that  an  allowance  of  5  per  cent  either  way 
75 

would  require  675  replies  in  the  sample.     Therefore,  increasing 

the  size  of  the  sample  somewhat  will  lead  to  a  decision  as  to  the 

next  step  in  this  uncertain  case. 

The  problem  obviously  turns  about  a  process  of  trial  and  error. 
The  initial  step  is  to  assume  a  value  of  p  which  is  believed  to  be 
most  reasonable.  The  results  obtained  from  the  sample  will 
show  whether  the  guess  is  entirely  satisfactory.  If  the  value  of  p, 
determined  by  the  sample,  approximates  very  closely  a  limiting 
value  which  would  make  a  given  project  commercially  undesir- 
able, as  in  the  foregoing  sample,  then  a  further  trial  must  be  made. 
This  must  be  repeated  as  long  as  there  is  doubt  in  regard  to  the 
result  obtained  for  the  problem  involved. 

Table  for  Size  of  Sample  to  Have  a  Given  Reliability.  In 
planning  market  researches,  a  number  of  estimates  of  the  type 
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indicated  above  must  frequently  be  made.  For  such  purposes, 
the  table  of  values  which  appears  on  pages  400  and  401  will  be 
found  convenient  for  reference  purposes. 

Certain  peculiar  characteristics  of  the  table  will  be  recognized. 
The  two  numbers  at  the  top  of  each  column  obviously  total  100 
per  cent.  One  value  is  for  p  and  the  other  is  for  q,  at  the  option 
of  the  user.  Moreover,  it  will  be  noticed  that  the  values  on  the 
top  row  go  only  to  50  per  cent.     For  values  greater  than  50  per 
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Fig.  69. — GYaph  illustrating  the  principle  upon  which  the  foregoing  theory 
is  based.     {Graph  copyrighted,   1933,   by  the  President  and  Fellows  of  Harvard 
College.) 

cent,  the  lower  row  should  be  used.  The  remaining  of  the  two 
values,  after  p  has  been  selected,  will  be  the  value  of  q.  The 
reason  that  this  can  be  done  is  that  the  formula  is  symmetrical 
for  p  and  q. 

The  column  on  the  left-hand  side  of  the  table  gives  the  error  in 
per  cent.  It  will  be  noted  that  along  the  top  of  the  columns  the 
values  are  not  all  equally  spaced  from  one  another,  the  lower 
values  being  separated  by  smaller  intervals.  The  figures  in  the 
body  of  the  table  give  the  number  of  items  in  each  case  corre- 
sponding to  the  values  of  p  and  q  in  the  error  selected.  Two 
illustrative  examples  will  indicate  the  use  of  the  table. 
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A  market  research  agency  desires  to  take  a  sample  for  which 
they  estimate  the  value  of  p  will  be  approximately  25  per  cent. 
They  wish  to  determine  this  with  an  accuracy  of  not  more  than 
1  per  cent  either  way.     How  many  items  will  be  required  in  the 

25 

sample?     Answer:  Under  the  column  headed  „    and  on  the  line 

opposite  1.0  in  the  column  headed  "Limits"  there  is  found  the 
value  16,875.     This  is  the  number  of  items  in  the  sample. 


Size  of  Sample  Necessary  to  Be  Practically  Sure  of  Accuracy 

(i.e.,  on  the  Basis  of  ±3<r) 

Within  Predetermined  Limits1 


Formula:  n 

9pq 
~   (3?)» 

Limits  ±  3er 

20 

25 

30 

35 

40 

45 

50 

(in  %) 

80 

75 

70 

65 

60 

55 

50 

0.1 

1,440,000 

1,687,500 

1,890,000 

2,047,500 

2,160,000 

2,227,500 

2,250,000 

0.2 

360,000 

421,875 

472,500 

511,875 

540,000 

556,875 

562,500 

0.3 

160,000 

187,500 

210,000 

227,500 

240,000 

247,500 

250,000 

0.4 

90,000 

105,469 

118,125 

127,969 

135,000 

139,219 

140,625 

0.5 

57,600 

67,500 

75,600 

81,900 

86,400 

89,100 

90,000 

0.6 

40,000 

46,875 

52,500 

56,875 

60,000 

61,875 

62,500 

0.7 

29 , 388 

34,439 

38,571 

41,786 

44,082 

45,459 

45,918 

0.8 

22,500 

26,367 

29,531 

31,992 

33,750 

34,805 

35 , 156 

0.9 

17,778 

20,833 

23,333 

25,278 

26,667 

27,500 

27,778 

1.0 

14,400 

16,875 

18,900 

20,475 

21,600 

22,275 

22,500 

1.5 

6,400 

7,500 

8,400 

9,100 

9,600 

9,900 

10,000 

2.0 

3,600 

4,219 

4,725 

5,119 

5,400 

5,569 

5,625 

2.5 

2,304 

2,700 

3,024 

3,276 

3,456 

3,564 

3,600 

3.0 

1,600 

1,875 

2,100 

2,275 

2,400 

2,475 

2,500 

3.5 

1,176 

1,378 

1,543 

1,671 

1,763 

1,818 

1,837 

4.0 

900 

1,055 

1,181 

1,280 

1,350 

1,392 

1,406 

4.5 

711 

833 

933 

1,011 

1,067 

1,100 

1,111 

5.0 

576 

675 

756 

819 

864 

891 

900 

6.0 

400 

469 

525 

569 

600 

619 

625 

7.0 

294 

344 

386 

418 

441 

455 

459 

8.0 

225 

264 

295 

320 

338 

348 

352 

9.0 

178 

208 

233 

253 

267 

275 

278 

10.0 

144 

169 

189 

205 

216 

223 

225 

15.0 

64 

75 

84 

91 

96 

99 

100 

20.0 

36 

42 

47 

51 

54 

56 

56 

25.0 

23 

27 

30 

33 

35 

36 

36 

30.0 

16 

19 

21 

23 

24 

25 

25 

35.0 

12 

14 

15 

17 

18 

18 

18 

40.0 

9 

11 

12 

13 

14 

14 

14 

Table  copyrighted,  1932,  by  the  President  and  Fellows  of  Harvard  College. 
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The  director  of  research  believes  that  the  proportion  of  homes 
for  a  product  which  he  is  interested  in  promoting  consists  of 
not  more  than  10  per  cent  of  the  total  number.  He  is  entirely 
satisfied  if  this  is  within  3  per  cent  either  way.  How  many  items 
must  be  in  the  random  sample  to  determine  this?     Reference  to 

column  Q    and  the  line  opposite  3  per  cent  will  show  the  answer 

to  be  900. 


Size  of  Sample  Necessary  to  Be  Practically  Sure  op  Accuracy 

{i.e.,  on  the  Basis  of  ±3cr) 

Within  Predetermined  Limits1 

(3*)2 


Formula:  n  = 


Limits  ±3? 

1 

2 

3 

4 

5 

10 

15 

(in  %) 

99 

98 

97 

96 

95 

90 

85 

0.1 

89,100 

176,400 

261,900 

345,600 

427,500 

810,000 

1,147,500 

0.2 

22,275 

44,100 

65,475 

86,400 

106,875 

202,500 

286,875 

0.3 

9,900 

19,600 

29,100 

38,400 

47,500 

90,000 

127,500 

0.4 

5,569 

11,025 

16,369 

21,600 

26,719 

50,625 

71,719 

0.5 

3,564 

7,056 

10,476 

13,824 

17 , 100 

32,400 

45,900 

0.6 

2,475 

4,900 

7,275 

9,600 

11,875 

22,500 

31,875 

0.7 

1,818 

3,600 

5,345 

7,053 

8,724 

16,531 

23,418 

0.8 

1,392 

2,756 

4,092 

5,400 

6,680 

12,656 

17,930 

0.9 

1,100 

2,178 

3,233 

4,267 

5,278 

10,000 

14,167 

1.0 

891 

1,764 

2,619 

3,456 

4,275 

8,100 

11,475 

1.5 

396 

784 

1,164 

1,536 

1,900 

3,600 

5,100 

2.0 

223 

441 

655 

864 

1,069 

2,025 

2,869 

2.5 

143 

282 

419 

553 

684 

1,296 

1,836 

3.0 

99 

196 

291 

384 

475 

900 

1,275 

3.5 

73 

144 

214 

282 

349 

661 

937 

4.0 

56 

110 

164 

216 

267 

506 

717 

4.5 

44 

87 

129 

171 

211 

400 

567 

5.0 

36 

71 

105 

138 

171 

324 

459 

6.0 

25 

49 

73 

96 

119 

225 

319 

7.0 

18 

36 

53 

71 

87 

165 

234 

8.0 

14 

28 

41 

54 

67 

127 

179 

9.0 

11 

22 

32 

43 

53 

100 

142 

10.0 

9 

18 

26 

35 

43 

81 

115 

15.0 

4 

8 

12 

15 

19 

36 

51 

20.0 

2 

4 

7 

9 

11 

20 

29 

25.0 

1 

3 

4 

6 

7 

13 

18 

30.0 

1 

2 

3 

4 

5 

9 

13 

35.0 

.7 

1 

2 

3 

3 

7 

9 

40.0 

.6 

1 

2 

2 

3 

5 

7 

Table  copyrighted,  1932,  by  the  President  and  Fellows  of  Harvard  College. 
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Such  tables  as  the  foregoing  are  highly  useful  in  marketing 
research,  but  in  no  absolute  sense  should  they  be  regarded  as 
dependable  and  conclusive.  As  pointed  out  on  page  54,  market- 
ing problems  are  commonly  subject  to  numerous  unsuspected  and 
unidentifiable  factors,  the  effect  of  which  on  a  series  of  samples 
cannot  be  predicted  or  measured  or  weighed.  However,  these 
computations  do  enable  one  to  arrive  at  fairly  safe  approxima- 
tions and,  with  such  adjustments  or  tolerances  as  may  seem 
necessary  in  each  case,  they  are  practical  for  most  marketing 
purposes  and  should  be  employed. 


BIBLIOGRAPHY  FOR  MARKETING  RESEARCH 

No  attempt  has  been  made  here  to  develop  an  exhaustive 
bibliography.  It  has  been  designed  rather  to  indicate  the  accessi- 
bility of  a  large  and  growing  literature  on  the  subject  of  marketing 
research  which  embraces  practically  every  phase  of  the  subject. 
To  do  more  than  this  in  a  work  of  this  kind  would  be  impossible. 
A  complete  list  of  all  the  books,  reports  and  articles  emanating 
from  all  the  departments  of  the  Federal,  state  and  municipal 
governments,  from  all  the  industrial  and  commercial  institutions 
and  from  all  the  six  hundred  or  more  trade  and  technical  journals 
would  manifestly  require  a  volume  in  itself.  This,  however, 
represents  an  adequate  bibliography  for  working  purposes. 

To  present  this  material  in  the  most  orderly  form,  the  books 
and  articles  have  each  been  placed  within  classes  suggested  by 
the  underlying  thought  or  purpose  in  each  case.  No  exact  lines 
of  demarcation  could  be  set  and  the  classification  is,  therefore, 
only  approximate. 
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Colleges  and  Universities,  Columbia  University  Press,  New  York,  1935. 

Boston  Conference  on  Distribution,  Boston  Chamber  of  Commerce,  Boston, 
1933-34-35. 

Crossley,  A.  M.:  Watch  Your  Selling  Dollar,  B.  C.  Forbes  Publishing  Com- 
pany, New  York,  1930. 

Foth,  J.  A. :  Trade  Associations,  Ronald  Press  Company,  New  York,  1930. 

Franken,  R.  B.,  and  C.  B.  Larrabee:  Packages  That  Sell,  Harper  &  Broth- 
ers, New  York,  1928. 

Giles,  Ray:  The  Sales  Expansion  Question  Book,  Harper  &  Brothers,  New 
York,  1930. 

Goslin,  R.  A.,  and  O.  P.  Goslin:  Rich  Man — Poor  Man,  Harper  &  Brothers, 
New  York,  1935. 

Haney,  Lewis  H.:  Business  Forecasting,  Ginn  and  Company,  Boston,  1931. 

Hardy,  C.  O.,  and  G.  V.  Cox:  Forecasting  Business  Conditions,  The  Mac- 
millan  Company,  New  York,  1927. 

Haring,  Albert:  Retail  Price  Cutting  and  Its  Control,  Ronald  Press  Com- 
pany, New  York,  1935. 

Haring,  Chester  C. :  The  Manufacturer  and  His  Outlets,  Harper  &  Brothers, 
New  York,  1930. 

Hilgert,  J.  R. :  Cost  Accounting  for  Sales,  Ronald  Press  Company,  New 
York,  1926. 

Little,  Arthur  D.:  Handwriting  on  the  Wall,  Little,  Brown  &  Company, 
Boston,  1928. 

Meredith,  L.  D.:  Merchandising  for  Banks,  Trust  Companies  and  Investment 
Houses,  Bankers   Publishing  Company,  Boston,  1935. 

Miller,  G.  L.:  Aesop  Glim,  Prentice-Hall,  Inc.,  New  York,  1931. 

Mooney,  J.,  and  A.  Reilly:  Onward  Industry,  Harper  &  Brothers,  New 
York,  1931. 
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Petersen,   Elmore:  A  Market  Analysis  of  the  Denver   Wholesale  Trade 

Territory,  University  of  Colorado,  Boulder,  1936. 
Rueff,  Jacques:  From  the  Physical  to  the  Social  Sciences,  Johns  Hopkins 

Press,  Baltimore,  1929. 
Saunders,  A.  G.  and  C.  R.  Anderson:  Business  Reports,   McGraw-Hill 

Book  Company,  Inc.,  New  York,  1929. 
Tausig,  F.  W.,  and  C.  S.  Josyln:  American  Business  Leaders,  The  Mac- 

millan  Company,  1932. 
Tead,  Ordway:  Creative  Management— The  Relation  of  Aims  to  Administra- 
tion, Association  Press,  New  York,  1936. 
Thompson,  W.  A. :  Making  Millions  Buy  and  Read,  Walter  Drey,  New  York, 

1934.  ' 
White,  Percival:  Sales  Quotas,  Harper  &  Brothers,  New  York,  1929. 
Williams,  J.  H.:  The  Flexible  Budget,  McGraw-Hill  Book  Company,  Inc., 

New  York,  1934. 

Psychology: 

Adler,  Alfred:  What  Life  Should  Mean  to  You,  (Ed.  by  Allan  Porter), 
Little,  Brown  &  Company,  Boston,  1931. 

Agencies  for  Psychological  Research  in  Business,  Annals  of  the  American 
Academy  of  Political  and  Social  Science,  Vol.  CX,  November,  1923, 
(Especially  with  W.  V.  Bingham  " Corporation  Business  Research.") 

Bentley,  Madison:  The  New  Field  of  Psychology,  D.  Appleton-Century 
Company,  Inc.,  New  York,  1934. 

Bernard,  Luther  Lee:  Instincts,  Henry  Holt  &  Company,  New  York,  1924. 

Bingham,  Walter  V.  and  Bruce  V.  Moore:  How  to  Interview,  Harper  & 
Brothers,  New  York,  1934. 

Boring,  Edwin  G.,  Herbert  S.  Langfeld  and  Harry  P.  Weld:  Psychology: 
A  Factual  Textbook,  John  Wiley  &  Sons,  Inc.,  New  York,  1936. 

Cantril,  Hadley  and  Alport:  Psychology  of  Radio,  Harper  and  Brothers, 
New  York,  1935. 

Craig  David  R.:  Acceptance  and  Rejection  of  Rayon  (Mimeographed  pam- 
phlet available  at  University  of  Pittsburgh  Retail  Research  Bureau), 

1934.  ... 

Freud,  Sigmund:  The  Psychopathology  of  Everyday  Life,  The  Macmillan 

Company,  New  York,  1917. 
Fry,  Luther  C:  Technique  of  Social  Investigation,  Harper  &  Brothers, 

New  York,  1934. 
Jenkins,  John  G.:  Psychology  in  Business  and  Industry,  John  Wiley  &  bons, 

Inc.,  New  York,  1935. 
Laird,  Donald  A.:  What  Makes  People  Buy,  McGraw-Hill  Book  Company, 

Inc.,  New  York,  1935. 
Link,  Henry:  New  Psychology  of  Selling  and  Advertising,  The  Macmillan 

Company,  New  York,  1932. 
Lucas,  D.,  and  C.  E.  Benson:  Psychology  for  Advertisers,  Harper  &  Brothers, 

New  York,  1930. 
Lundberg,   George  A.:  Social  Research,  Longmans,  Green  &  Company, 

New  York,  1929. 
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Murphy,  Gardner  and  Murphy:  Experimental  Social  Psychology,  Harper  & 
Brothers,  New  York,  1931. 

Pitkin,  Walter:  The  Consumer — His  Nature  and  Changing  Habits, 
McGraw-Hill  Book  Company,  Inc.,  New  York,  1932. 

Poffenberger,  A.  T. :  Psychology  of  Advertising,  McGraw-Hill  Book  Com- 
pany, Inc.,  New  York,  1932. 

Vitellis,  Morris  Simon:  Industrial  Psychology,  W.  W.  Norton  &  Company, 
Inc.,  New  York,  1932. 

Young,  P.  V.:  Interviewing  in  Social  Work,  McGraw-Hill  Book  Company, 
Inc.,  New  York,  1935. 

Statistical: 

Bowley,  A.  L.:  Elements  of  Statistics,  P.  S.  King  &  Sons,  London,  1920. 

Brown,  Theodore  H.:  Use  of  Statistical  Technique  in  Certain  Problems  of 
Market  Research,  Harvard  University,  Cambridge,  1935. 

Brown,  Theodore  H.,  R.  F.  Bingham,  and  V.  A.  Temnomeroff:  Labora- 
tory Handbook  of  Statistical  Methods,  McGraw-Hill  Book  Company, 
Inc.,  New  York,  1931. 

Chaddock,  Robert  E.:  Principles  and  Methods  of  Statistics,  Chap.  XVI, 
Houghton  Mifflin  Company,  Boston,  1925.^ 

Croxton,  F.  E.,  and  D.  J.  Cowden:  Practical  Business  Statistics,  Prentice- 
Hall,  Inc.,  New  York,  1934. 

Crum,  W.  S.,  and  A.  C.  Paton:  Economic  Statistics,  A.  W.  Shaw  &  Co. 
(now  McGraw-Hill  Book  Company,  Inc.),  1925. 

Davies,  G.  R.:  Introduction  to  Economic  Statistics,  D.  Appleton-Century 
Company,  Inc.,  New  York,  1922. 

Day,  D.  E.:  Statistical  Analysis,  The  Macmillan  Company,  New  York, 
1932. 

Jerome,  Harry:  Statistical  Method,  Harper  &  Brothers,  New  York, 
1924. 

Kelley,  Truman  L.:  Statistical  Method,  The*  Macmillan  Company,  New 
York,  1923. 

King,  Willford  I.:  Elements  of  Statistical  Method,  The  Macmillan  Com- 
pany, New  York,  1912. 

:  Index  Numbers  Elucidated,  Longmans,  Green  &  Company,  New 

York,  1930. 

Macaulay,  F.  R.:  Smoothing  of  Time  Series,  National  Bureau  of  Economic 
Research,  New  York,  1931. 

Mills,  Frederick  C:  Statistical  Methods,  Henry  Holt  &  Company,  New 
York,  1924. 

Rietz,  H.  L.:  Handbook  of  Mathematical  Statistics,  Houghton  Mifflin  Com- 
pany, Boston,  1924. 

Riggleman,  John  R.,  and  Ira  N.  Frisbee:  Business  Statistics,  McGraw-Hill 
Book  Company,  Inc.,  New  York,  1932. 

Secrist,  Horace:  Introduction  to  Statistical  Methods,  The  Macmillan  Com- 
pany, New  York,  1917. 

Yule,  G.  Udney:  An  Introduction  to  the  Theory  of  Statistics,  Charles  Griffin 
&  Company,  Ltd.,  London,  1932. 
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Use  of  English: 

A  Manual  of  Style,  9th  ed.,  University  of  Chicago  Press,  Chicago   1927 

Batten,  Goodrich  and  Toogood:  The  Written  Word,  Greenberg,  Publisher, 

Inc.,  New  York,  1932.  . 

Canby,  Henry  Seidel:  English  Composition  in  Theory  and  Practice,  Ihe 

Macmillan  Company,  New  York,  1919. 
Cole,  Arthur  H.,  and  Karl  W.  Bigelow:  A  Manual  of  Thesis-Writing, 

John  Wiley  &  Sons,  Inc.,  1934. 
Htjlbert,  J.  R.,  and  V.  B.  Hulbert:  Effective  English,  University  of  Chicago 

Press',  Chicago,  1929. 
Manly,  J.  M.:  2%«  TPrtfww  of  English,  Henry  Holt  &  Company,  New  York, 

Small,  W.  K.:  Handbook  of  Effective  Writing,  Harper  &  Brothers,  New  York, 
1931. 

MAGAZINES 
The  following  articles  all  have  a  bearing  on  marketing  research. 
They  are  only  a  few  of  the  great  number  written  and  published  in 
the  business  press  during  the  past  ten  years.  These  will,  however, 
suffice  to  show  the  broad  variety  of  subject  matter  and  treatment, 
and  there  are  enough  to  yield  to  the  student  considerable  informa- 
tion on  several  of  the  major  phases  of  marketing  research. 

Discussions  of  Research: 

Adams   Irwin -S.:  "The  Consumer  Answers  Some  Questions  for  Jantzen," 
Printers'  Ink  Monthly,1  Printers'  Ink  Publishing  Company,  New  York, 

August,  1929.  _  _     „   0  . 

Arnold    Pauline:  "How  Shifts  in  Media  Affect  Cigarette  Sales,     Sales 
Management,*  Sales  Management,  Inc.,  New  York,  Aug.  1,  1935.     (An 
•     analysis  with  charts  showing  that  there  is  a  definite  correlation  between 
percentage  appropriations  spent  for  radio  and  the  relative  sales  posi- 
tion of  three  brands  of  cigarettes.) 

"Automobile  Survey,"  Fortune  Magazine,  Time-Fortune  Corporation,  New 
York,  July  17,  1935.  „ 

Bader,  Louis:  "Customer  Preference  for  Brands  m  Grocery  Products 
Journal  of  Retailing,*  New  York  University,  New  York,  July,  1934. 
(A  study  of  brand  preferences  as  disclosed  by  1,300  customers  who  made 
2,500  purchases.)  . 

Bingham,  H.  Y.:  "National  Brands  Take  Lead:  Recent  Surveys,  Food 
Industries,  McGraw-Hill  Publishing  Company,  New  York    June ,1935. 

"Brand  Preferences  and  Sales  Trends  in  Rural  Markets,"  S.M.,  March, 
1934.  (A  survey  of  750  drug-  and  750  grocery-store  proprietors  regard- 
ing changes  in  brands  and  volume  between  1933  and  1934.) 

1  Hereinafter  referred  to  as  P.  /.  M. 

2  Hereinafter  referred  to  as  S.  M. 

3  Hereinafter  referred  to  as  J.  of  R. 
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Cassady,  R.,  Jr.,  and  H.  M.  Haas:  "Analyzing  the  Market  of  Mail  Order 
House  Retail  Stores,"  Harvard  Business  Review,1  McGraw-Hill  Book 
Company,  Inc.,  New  York,  Vol.  XIII,  July,  1935.  (Gives  information 
about  the  consumer,  such  as:  "How  Far  Customers  Drive  to  Shop." 
From  such  questions  arrives  at  the  limits  of  market  area.  Charts 
simplify  the  survey.) 

"Cigarette  Survey,"  Fortune  Magazine,  July  17,  1935. 

"Cleveland  Bathroom  Survey  Shows  Vast  Market  for  New  Products," 
S.  M.,  May  1,  1935. 

"Cleveland  Kitchen  Count,"  Advertising  and  Selling*  Robbins  Publishing 
Company,  New  York,  Sept.  26,  1935. 

Cowan,  Donald  R.  G.:  "Regional  Consumption  and  Sales  Analysis," 
Journal  of  Business,  University  of  Chicago  Press,  Chicago,  Vol.  VIII, 
October,  1935.  (Charts  deal  mostly  with  per-capita  income  correla- 
tions, the  relationships  of  per-capita  sales  to  regional  estimates  of  a 
specific  product — as  cheese.) 

Davenport,  Orton  and  Roby:  "Regional  Plan  of  New  York  and  Its 
Environs,"  Business  Regional  Plan  of  New  York  and  Its  Environs, 
130  W.  22d  St.,  New  York  City.  (Deals  with  retail  shopping  and 
financial  districts.) 

Donley,  J.  G.:  "If  Business  Doctors  Held  Post-Mortem,"  P.  I.  M.,  Febru- 
ary, 1932.  (Analysis  of  an  unsuccessful  effort  to  introduce  modern 
furniture  in  the  U.  S.     Failure  to  make  a  market  analysis.) 

"Find  100  Markets  Provide  84  per  cent  of  17  Products  Potential,"  S.  M., 
June  15,  1935. 

Grid-ley,  Don:  "Fifty-five  Consumer  Contests,"  P.  /.  M.,  March,  1935. 
(An  analysis  of  consumer-contest  trends.) 

Gridley,  S.:  "Kippers  and  Bloaters,"  Printers'  Ink  Weekly,3  Mar.  21,  1935. 
(British  Government  survey  of  fishing  industry.) 

Hettinger,  H.  S.:  "Has  Radio  Changed  in  1934?"  A.  &  S.,  May  10,  1934. 
(An  analysis  of  radio  program  trends.) 

"How  Ten  Thousand  House  Wives  Rate  Drug,  Cigarette  and  Auto  Ads," 
S.  M.,  Aug.  15,  1935. 

"How  Ten  Thousand  House  Wives  Rate  Grocery  Product  Advertisements," 
S.  M.,  July  15,  1935. 

Market  Research  Corporation  of  America:  "How  Housewives  Rate 
Grocery  Product  Advertising,"  S.  M.,  July  15,  1935.  (A  study  of 
product  brand  recall  based  on  recent  advertisements  seen  by  women.) 

-:  "Ten  Thousand  Women  Tell  Why  They  Dislike  Certain  Adver- 
tisements," S.  M.,  June  15,  1935.  (A  discussion  of  the  facts  revealed  in 
the  survey.) 

:  "What  Kinds  of  Advertisements  Do  Women  Like?"     S.  M.,  July  1, 


1935. 
"Market  Study  of  the  Importance  of  Farm  Trade  in  Small  Towns."     Far- 
mer's Wife,  Webb  Publishing  Company,  St.  Paul,  1934. 

1  Hereinafter  referred  to  as  H.  B.  R. 

2  Hereinafter  referred  to  as  A.  &  S. 

3  Hereinafter  referred  to  as  P.  /. 
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Ross  Federal  Service,  Inc.:  "The  Consumer  Goes  to  Market  with  What 
and  for  What?"  S.  M.,  Mar.  15,  1934.  (Responds  to  number  of  sug- 
gestions from  subscribers;  is  one  of  a  series  in  which  different  products 
were  analyzed  and  brand  preferences  noted.) 

:  "What  Products  Does  the  Grocer  Push?"     S.  M.,  May  15,  1934. 

(Presents  a  list  of  products  receiving  20  per  cent  or  more  of  the  total 
recommend  ation . ) 

Salisbury,  Philip:  "Does  Advertising  Pay?"  S.  M.,  October,  1935.  (A 
study  of  the  advertising  in  30  consumer  (industry)  magazines  during 
the  period  1915  to  1934.) 

Stanton,  F.  N.:  "Checking  the  Checkers,"  A.  &  S.,  Dec.  19,  1935.  (A 
discussion  of  the  successful  use  of  the  audimeter  for  checking  listeners 
in  radio  programs.) 

Starch,  Daniel:  "Blind  Spots— A  Challenge  to  the  Gas  Industry."  The 
Gas  Age-Record.  Robbins  Publishing  Company,  New  York,  Vol. 
LXXVI,  August,  1935. 

"Survey  among  Ten  Thousand  Housewives,"  S.  M.,  June  1,  1935.  (Con- 
cerns the  impression  created  by  different  advertisements.) 

Weeks,  H.:  "Market  Survey  for  the  Gas  Industry,"  Gas  Journal,  London, 

Oct.  9,  1935. 
Wingate,  John  W.,  and  Eugene  Romney,  Jr.:  "Brand  Promotion  in 
Department  Stores,"  /.  of  R.,  July,  1934.     (A  survey  among  58  depart- 
ment stores  and  5,000  advertised  items  to  determine  status  of  brand.) 

Economics: 

Bader,  Louis:  "Can  We  Find  Out  How  the  American  Income  is  Spent?" 
Journal  of  American  Statistical  Association,  September,  1931.  (A  com- 
parison of  estimates  of  income  expenditures  setting  off  family-budget 
studies  against  lump-sum  estimates.) 

:    "Population    Movement   in    Business,"    J.    of  R.,    April,    1935. 

(Deals  with  the  declining  rate  of  growth  and  changes  in  composition  of 
population.) 
Bader,  Louis:  "Family  Budget  Studies  as  an  Aid  to  Retailers,"  /.  of  R., 

October,  1935. 
Brown,  Theodore  H.:  "Control  of  Distribution,"  Mechanical  Engineering, 
American  Society  of  Mechanical  Engineers,   New  York,  December, 
1934.  i      _ 

Bush,  A.  L.:  "Consumer  Use  of  Selected  Goods  and  Services  by  Income 
Classes,"  Market  Research  Series  No.  5.,  U.  S.  Bureau  of  Foreign  & 
Domestic  Commerce,  Washington. 
Copeland,  Morris  A.:  "An  Index  of  the  Dollar  Volume  of  Retail  Trade, 
1914-1927,"   Vol.   VII,   January,    1929.     (Indicates  the  difficulty  of 
constructing  the  kind  of  indexes  which  business  needs.) 
Furbush,  F.:  "Farmers'  Spendable  Income,"  P.  I.  M.,  January,   1936. 
(Analyses  of  increase  between  1932  and  1935.     Sales  of  various  items, 
field  comments,  investigations,  manufacturers,  dealers.     Information 
can  be  obtained  from  U.  S.  Dept.  of  Agriculture,  Dept.  of  Commerce, 
Trade  Papers  and  Research  Depts.  of  Farm  Publications.) 
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Furnas,  C.  C:  "The  Ultimate  Industrialism,"  Scientific  Monthly,  Scientific 
Press,  New  York,  July,  1930.  (A  speculation  on  what  may  be 
expected  in  the  20th  century  as  necessary  for  living.) 

"Government  Surveys  Show  Families  with  Moderate  Incomes  Buy  Most," 
S.  M.,  Nov.  1,  1935.     (Consolidated  table  summarizing  results.) 

Gragg,  Charles  I.:  "Diagnosis  and  the  Developing  Science  of  Business," 
H.  B.  R.,  Vol.  X,  January,  1932.  (The  need  for  emphasis  on  diagnosis 
in  connection  with  business  predicaments.) 

Hamng,  Chester  E.:  "B.  B.  D.  &  O.  Buying  Power  Index,"  A.  &  S.,  Nov. 
9,  1923. 

Haring,  H.  A.:  "The  Negro  as  Consumer,"  A.  &  S.,  Sept.  3,  1930.  (Treats 
of  the  improvements  in  earnings  of  the  Negro  in  the  North.) 

Henrichs,  A.  F.:  "The  Measurement  of  Consumer  Demand  and  Economic 
Planning,"  American  Marketing  Journal,  American  Marketing  Society, 
New  York,  April,  1934. 

House,  Jay  E.:  "Main  Street  is  Broadway  Now,"  Nation's  Business,  Cham- 
ber of  Commerce  of  the  U.  S.,  Washington,  April,  1930.  (Deals  with 
the  transformation  that  has  been  taking  place  in  the  small  towns  pat- 
'  terning  after  the  large  cities  because  of  the  influence  of  transportation, 
radio  and  newspapers.) 

LaCrosse,  H.  T.:  "Consumer  Debt  Study,"  Market  Research  Series  No. 
2,  U.  S.  Bureau  of  Foreign  and  Domestic  Commerce,  Washington, 
March,  1935. 

McNiece,  Thomas  M.:  "Analysis  of  Wholesalers'  Operating  Costs," 
H.  B.  R.,  Vol.  VII,  October,  1928.  (This  article  presents  a  method  for 
discovering  the  relative  costs  of  handling  various  classes  of  products 
by  wholesalers.) 

"More  People  Employed  But  Income  Smaller  in  1934,"  S.  M.,  Mar.  15, 
1935.     (Editorial  comment  on  N.  Y.  U.  Survey  by  Prof.  Hugh  Agnew.) 

Pepin,  Rene:  "How  to  Define  Markets  By  City,  County  Population 
Groups,"  S.  M.,  Sept.  15,  1935.  (Author  introduces  a  new  method  for 
evaluating  markets  and  locating  purchasing  power.) 

Prescott,  R.  B.:  "Sales  Management  Sectional  Index  of  General  Business," 
S.  M.,  Oct.  1,  1935.  (By  geographical  census  divisions — based  on 
monthly  average  1923-1925  as  100.) 

Ryan,  F.  W.:  "Functional  Elements  of  Marketing  Distribution,"  H.  B.R., 
Vol.  XII,  October,  1934;  Vol.  XIII,  July,  1935.  (These  articles  repre- 
sent a  part  of  a  research  study  of  the  general  problems  of  municipal 
control  of  retail  trade.) 

"Sales  Management's  Survey  of  Spending  Power,"  S.  M.,  Apr.  10,  1935. 
(Gives  total  spendable  money  income  from  all  sources;  official  retail 
sales  figures;  new  passenger-car  sales  by  counties  and  cities  of  10,000 
population  and  over.) 

Vaile,  Roland  S.:  "The  Use  of  Advertising  During  Depression,"  H.  B.  R., 
Vol.  V,  April,  1927. 

Wadsworth,  J.:  "Effect  of  Government  Relief  on  Sales  Programs,"  A.  &  S., 
Sept.  15,  1935. 
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Weaver,  Henry  G.:  "The  Development  of  a  Basic  Purchasing  Power 

Index  By  Counties,"  H.  B.  R.,  Vol.  IV,  April,  1926. 
Weld,  L.  H.  D.:  "Advertising  Index  and  Industrial  Activity,"  P.  i".  M., 

April,  1935.     (An  explanation  of  the  advertising  index  developed  by 

the  author.) 
— :  "  Advertising  Activity  and  Freight  Car  Loadings,"  P.  I.  M.,  July, 

1935.     (Subject  discussed  as  index  of  business  activity.) 

Marketing  Research: 

Acker,  E.  R.:  "How  Market  Research  Determines  What  Can  Be  Sold  to 

Customers,"  Gas  Age-Record,  Vol.  LXXVI,  Aug.  3,  1935. 
Alspatjgh,  R.  B.:  "Present  Status  and  Future  Outlook  of  Consumer 
Research  in  Commercial  Firms,"  The  American  Marketing  Journal, 
April,  1935.  (A  general  discussion  of  consumer  research.) 
Bader,  Louis:  "Practice  of  Marketing  Research  and  Market  Forecasting  in 
the  Textile  Industries,"  American  Marketing  Journal,  July,  1934. 
(Based  upon  interviews  with  388  textile  concerns.) 

-:  "Survey  of  the  Effectiveness  of  House  to  House  Canvassing,"  J.  of 

R.,  January,  1935.     (A  survey  in  three  New  York  suburban  towns  to 
determine  the  attitude  toward  "bell  ringers.") 
Blood,  H.  E. :  "How  to  Measure  Advertising  Results,"  A.&S.,  May  23, 1935. 

:  "Comparative  Research,"  P.  I.,  Aug.  22,  1935. 

Bltjmberg,  Ratjle:  "New  Method  of  Measuring  Media  Markets,"  P.  I., 

Oct.  26,  1933. 
Burdick,  C.  L.:  "Does  Consumer  Research  Pay?"     Chemical  and  Metal- 
lurgical Engineering,  McGraw-Hill  Publishing  Company,  New  York, 
January,  1935. 
Coleman,  Lloyd  R.:  "What  is  your  Research  Worth?"     A.  &  S.,  Nov.  30, 

1927. 
Coutant,  Frank  R.:  "Research  as  an  Aid  to  Pricing  and  Production," 
American  Marketing  Journal,  July,  1934. 

:  "Developments  in  Copy  Testing  Technique,"  American  Marketing 

Journal,  April,  1935. 
Cox,  Reavis:  "Selling  Below  Cost  as  a  Problem  in  Marketing  Research," 

American  Marketing  Journal,  July,  1934. 
Donald,  W.  J.:  "Management  Research  Methods,"  H.  B.  R.,  Vol.  V, 
January,  1927.     (A  plea  for  development  of  methods  of  research  as 
fundamental  and  descriptive  of  qualifications  for  research  work.) 
Eldridge,  F.  R.:  "Advertising  and  Selling  Abroad,"  P.  /.  M.,  December, 
1930.     (Discusses   the   research  necessary  when  planning   a  foreign 
sales  campaign.) 
Geraghty,  F.  D.:  "Boost  Sales  by  Market  Analysis,"  P.  J.  M.,  September, 
1932.     (A  report  of  what  was  done  by  the  American  Enameled  Brick 
Corp.  following  a  market  analysis  to  achieve  a  greatly  increased  sale  of 
its  products.) 
Harris,  Constance:  "Which  are  the  Best  Test  Market  Cities?"     S.  M., 
Aug.  15,  1935. 
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Hovde,  H.  T.:  "Recent  Trends  in  Development  of  Market  Research," 
American  Marketing  Journal,  January,  1936.  (A  report  on  trends 
during  1935.     Noteworthy  for  the  fine  bibliography  attached  to  it.) 

Hovey,  C.  E.:  "Market  Research  Usage,"  P.  I.  M.,  May,  1935.  (A  state- 
ment of  the  more  important  uses  to  which  market  research  may  be  put.) 

Kedzierski,  S.  L.:  "Studies  in  Marketing  Research  of  the  Bureau  of  Foreign 
and  Domestic  Commerce,"  spec,  ed.,  Oil  Paint  and  Drug  Reporter,  New 
York.     Oil  Paint  and  Drug  Reporter,  Inc.,  Oct.  15,  1935. 

Kendall,  H.  P.:  "Merchandising  Starts  with  the  Raw  Material,"  P.  7.  M., 
July,  1930.  (An  illustration  of  the  variety  of  research  necessary  in  a 
business  enterprise.) 

King,  Robert  N.:  "Fallacy  of  Large  Numbers  in  Survey  Field  Work/' 
A.  &  S.,  Feb.  14,  1935. 

Laird,  Donald  A.:  "The  Trustworthy  Survey  is  Yet  to  be  Made,"  P.  I.  M., 
July,  1922. 

Lyon,  Leverett  S.:  "Field  of  Market  Research  Suggested  by  N.  R.  A. 
Experience,"  National  Marketing  Review,  (National  Association  of 
Marketing  Teachers)  Business  Publications,  Inc.,  Chicago,  Fall  Issue, 
1935. 

McGptena,  L.  E.:  "High  Cost  of  Bad  Research,"  P.  /.,  May  16,  1935. 

Nash,  Ben:  "Selling  What  the  Consumer  Wants,"  P.  7.  M.,  November, 
1930.  (Stresses  use  of  research  to  determine  what  the  consumer  wants 
and  will  buy.) 

Onthank,  A.  Heath:  "Improving  the  Coordination  of  Advertising  and 
Selling,"  Bureau  of  Research  and  Education  of  the  International 
Advertising  Association  (now  Advertising  Federation  of  America), 
April,  1929.      (A  strong  argument  for  marketing  research.) 

Powers,  P.  H.:  "Learning  from  Our  Customers,"  Edison  Electric  Institu- 
tion, Bulletin  No.  2,  May,  1935.  (Marketing  research  program  and  cost 
data  of  the  West  Pennsylvania  Power  Company.) 

Reed,  Vergil  D.:  "Why  Market  Surveys  Fail  Sometimes,"  P.  7.  M., 
September,  1930.  (Explains  why  advertising  agencies,  publishers  and 
firms  own  inside  man  not  always  effective.) 

■ :  "The  Census  of  Business  as  an  Aid  to  Market  Measurement," 

American  Marketing  Journal,  January,  1936.     (How  to  use  the  census 
of  business  for  analyzing  markets.) 

Rushmore,  Elsee  M.:  "The  Future  of  Advertising  Research,"  P.  7.  M., 
June,  1930.  (An  account  of  the  various  problems  in  marketing  research 
which  an  advertising  agency  can  be  expected  to  attempt  to  solve  for 
clients  if  advertising  agency  is  to  continue  to  justify  itself.) 

:  "How  to  Get  Results  in  Mail  Questionnaires,"  P.  I.,  Mar.  22,  1934. 

Shaw,  A.  W.:  "Some  Problems  in  Market  Distribution,"  Quarterly  Journal 
of  Economics,  University  of  Chicago,  Chicago,  August,  1912.  (Presents 
a  plan  for  a  consumer  research  and  suggests  a  classification.) 

Smith,  B.  W.:  "Research  in  Retailing,"  J.  of  R.,  January,  1933.  (Deals 
with  the  new  research  spirit  among  retailers.) 

"Testing  Displays."  P.  I.,  July  18,  1935.  (Describing  some  of  the  meth- 
ods employed.) 
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Weaver,  Henry  G.:  "Consumer  Questionnaire  Technique,"  American 
Marketing  Journal,  July,  1934. 

Weld,  Louis  D.  H.:  "  Measuring  Sales  Potentials,"  P.  I.,  July  31  to  Sept.  11, 
incl.,  1930.     (An  instructive  description  of  the  procedure.) 

Weld,  L.  D.  H.:  "Scientific  Determination  of  Regional  Sales  Potentials," 
American  Marketing  Journal,  January,  1936.  (Explains  how  regional 
sales  potentials  were  arrived  at  for  a  group  of  concerns  in  one  industry. 
Charts  are  presented  and  their  construction  indicated.) 

Wheeler,  Ferdinand  C:  "Agency  Research  Has  Still  Another  Step  to 
Take,"  P.  /.  M.,  September,  1930.  (The  step  is  that  of  investigating 
inside  the  business  as  well  as  outside.  Failures  of  advertising  often 
result  from  lack  of  coordination  in  the  client's  own  organization.) 

:    "New    Methods   and   Results   in    Market   Research,"   American 

Marketing  Journal,  January,  1935.  (Reviewing  innovations  in  research 
technique  as  related  to  collection,  organization  and  interpretation  of 
data.) 

White,  W.  L.:  "Market  Research  Activities  in  Department  of  Commerce," 
American  Marketing  Journal,  January,  1936.  (Reports  on  what  the 
department  does  and  shows  some  of  the  reports  and  publications  being 
issued.) 

Miscellaneous: 

Arnold,  Pauline:  "Marketing  New  Products— Part  I;"  Market  Research, 

Market  Research  Corporation  of  America,  New  York,  July,  1935. 
Barrett,  P.  V.:  "Tests  Prove  Profitable,"  P.  /.  M.,  September,   1935. 

(Report  of  the  vast  fund  of  information  assembled  and  being  used  by 

I.  C.  S.  on  factors  affecting  advertising.) 
Battin,    Charles    T.:    "The    Economic    Organization   and    Competitive 

Status  of  the, Chicago  Potato  Market,"  Journal  of  Business,  January, 

1935.     (This  article  is  a  thorough  discussion  of  the  marketing  problems 

in  the  potato  industry.) 
"Brand  Preferences  in  Milwaukee,"  A.  &  S.,  June  6,  1935.     (Drawn  from 

"Consumer  Analysis,"  Milwaukee  Journal,  1935  ed.) 
Calloway,  Cason  J.:  "How  Concentration  Developed  a  Profit-making 

Mine,"  P.  /.,  Jan.  1,  1921.     (Story  of  a  study  which  increased  profits  by 

concentrating  on  restricted  number  of  items.) 
Chamberlain,  F.  W.:  "Feeling  Your  Way  in  a  Fickle  Market."     P.  /.  M., 

June,  1930. 
Chilson,  Francis:  "Before  You  Design  that  New  Package,"  P.  /.  M., 

February,  1932.     (Suggestions  of  procedure  to  be  followed  in  such  cases.) 
Colby,  Lester  B.,  "Why  Many  Sales  Estimate  Indices  Go  Haywire  in 

Local  Markets,"  S.  M.,  Feb.  1,  1934. 
Connitt,  E.  B.:  "Sampling  Can  Become  an  Epidemic,"  P.I.M  ,  November, 

1929.     (Describes  an  investigation  of  dealers  and  consumers  in  the 

soap-and-cleanser  field  in  San  Francisco.) 
Corwin,    Charles:   "Canada  Post   Office   Aids  Advertisers,"  P    I    M, 

January,   1935.     (Data  regarding  a  trading  area  made  available  to 

Canadian  advertisers.) 
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Dahl,  Crete  M.:  "Helpful  Records  for  Sales  Promotion  Departments," 
P.  I.  M.,  May,  1930.  (The  need  for  keeping  a  record  of  the  various 
things  done  in  a  marketing  department  for  reference  purposes.) 

Dickinson,  R.:  "Advertising  an  Investment:  The  Creation  of  Buyers  and 
Potential  Customers,"  P.  I.,  Aug.  8,  1935.     (General  discussion.) 

Dignam,  Dorothy:  "The  British  Like  Cold  Toast  for  Breakfast,"  P.  I.  M., 
March,  1930.  (A  plea  for  a  study  of  the  consumer  in  connection  with  a 
product  before  putting  it  on  the  market.  Lists  a  number  of  customs  in 
European  countries  calling  for  changes  in  American  electrical  appliances 
before  they  can  be  sold  abroad.) 

Eastman,  L.  J.:  "Sampling  the  1935  Motor  Car  Prospect,"  A.  &  S.,  Mar. 
14,  1935. 

Eckhardt,  Henry:  "The  Demise  of  Quality,"  A.  &  8.,  Aug.  20,  1930. 
(Deals  with  the  changing  desires  of  the  consumer  and  the  effect  on  a 
variety  of  industries.) 

Engle,  Nathaniel  H.:  "Small-town  Sales  Opportunities,"  A.  &  S., 
May  26,  1932.  (A  discussion  of  opportunities  in  towns  under  10,000 
population.) 

:   "New   Census   Studies   Reveal   Wide   Variations  in   Commodity 

Markets,"  A.  &  S.,  Aug.  4,  1932.     (Analysis  of  some  phases  of  the 
census  of  distribution  as  applied  to  soap  and  toilet  preparations.) 

Epstein,  Ralph  C. :  "Producers'  Growth  Curves  in  an  Expanding  Industry," 
H.  B.  R.,  Part  I,  Vol.  6,  April,  1928;  Part  II,  Vol.  VII,  October,  1928. 
(Two  articles  discussing  importance  of  ever-recurring  changes  in 
product  and  policy.) 

Falk,  Alfred  T.:  "Analyzing  Advertising  Results,"  H.  B.  R.,  Vol.  VII, 
Part  1,  January,  1929;  Part  II,  April,  1929.  (A  study  of  one  company's 
advertising  over  14  years  to  measure  the  effectiveness  of  a  particular 
advertisement  from  the  point  of  view  of  (1)  seasonal  factors;  (2)  size  of 
space  used;  (3)  lasting  quality  of  advertising  used;  (4)  frequency  of 
appearance;  (5)  intensiveness  of  advertising;  (6)  secular  external 
factors.) 

Ferebee,  E.  E. :  "The  Use  of  Public  Merchandising  Warehouses  in  Chicago," 
Journal  of  Business,  1934. 

Fetherston,  T.  C:  "Why  Not  an  Editorial  Audit  Bureau?"  P.  I.  M., 
November,  1935.      (A  discussion  of  qualitative  analysis  of  periodicals.) 

Frank,  Philip:  "Key  to  Point-of-Sale  Advertising, "A.  &  S.,  Nov.  9,  1935. 
(An  analysis  of  the  factors  to  be  considered  in  display  of  packages.) 

Freyd,  Max:  "Experimental  Evaluation  of  Merchandising  Unit,"  H.B.R., 
Vol.  IV,  January,  1926.  (A  good  illustration  of  the  experimental 
method  in  the  business  of  selling.) 

:  "Analysis  of  Keyed  Returns,"  H.  B.  R.,  Vol.  IV,  April,   1926. 

(General  discussion). 

Goode,  Kenneth  M.:  "Why  Inquiries  Indicate  Sales,"  A.  &  S.,  Aug.  4, 
1932.  (An  account  of  test  made  by  Resinol  to  measure  the  effectiveness 
of  ads.  making  offers.) 

Gridley,  Don.:  "Packaging  for  Use,"  P.  /.  M.,  September,  1935.  (Meth- 
ods which  have  been  devised  to  make  product  packages  more  useful.) 
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Grimes,  Bernard  A.:  "How  Do  Advertisers  Fomd /^,  P^u^" 
P  I  M  August,  1932.  (An  account  of  the  new  products  developed  by 
twenty  different  companies  following  some  study  of  the  situation.) 

Grimes,  B.  A.:  "Twenty  Basic  Questions  on  Business  Films,  P.  1.  M., 
August,  1935.  .  .  ,  „   r     ,  p 

Hales    Alden  A.:  "Distribution  of  Retail  Advertising  Budget     J.  o]  K 
July    1932      (48  stores  contributed  data  and  opinions  to  this  timely 
research  study.     Emphasis   on  special  promotions  is  evidently  not 
regarded  as  a  normal  policy.) 

Hall  C  M  :  "Pretests  for  Premiums/'  P.  I.  M.,  August,  1935.  (Dis- 
cussing the  value  of  premium  merchandise  by  the  use  of  various  pre- 

Halpe^  J  ^  How  a  Sales  Story  is  Built/'  P.  7.,  Sept.  5,  1935.  (Survey 
among  women  reveals  data  about  silk  underwear.)  .-,.,„ 

HardTg  T  Swan:  "Science  and  the  Money-minded/'  AtlanMc  Monthly, 
Soughton  Mifflin  &  Company,  Boston,  May,  1930.  (Discusses  the 
dependence  of  the  research  man  in  science  upon  the  person  with  money.) 

Hay  R  C:  "Operation;  Planning;  Training-Sales  Managers  Big  Three 
PL  M.,  September,  1935.     (A  critical  study  of  the  working  methods 

HeT"r,  hT"  The  Future  of  Radio  as  an  Advertising  Medium/'  Journal 
1  ~      of  Business,  October,  1934.     (The  author  makes  an  evaluation  of  radio 

as  an  advertising  medium.) 
Hinsdale,  M.  W.:  "Restricted  Season  on  Dealer  Surveys,     A.  &  b.,  Mar. 

Howe8'  Tm,.  "Why  They  Don't  Buy,"  P.  I,  July  4,  1935.     (Seventy 

reasons  why  sales  are  sidetracked.) 
Howell,  William  F.:  "Designing  for  Shelf  Appeal,"  P.  I.M.,  May, ,1935^ 

(Some  of  the  present  appeal  factors  to  be  considered  in  designing  a 

HYSLPoapksS:  "Window  Displays  in  New  York  City,"  J.  of  R,  July,  1935. 
(A  study  of  the  windows  in  24  leading  New  York  stores  for  six  weeks  to 
determine  popularity.)  rA 

Kerlin  L  J  :  "Let's  Forget  State  Lines,"  P.  /•  M.,  August,  1930.  (A 
description  of  how  the  National  Carbon  Company  bases  its  salesmen  s 
territories  on  the  wholesale  trading  area.) 

Laing,  W.  T.:  "Keeping  Tabs  on  Markets,"  P.  /.,  June  27,  1935.  (Ques- 
tionnaire to  coupon  senders.)  TTphrnorv 

Larrabee,  C.  D.:  "When  Choosing  Package  Closure,"  P.  I.M.,  February, 
itS      (A  study  of  the  factors  which  aid  in  the  sale  of  the  package.) 

Lazarsfeld  Paul  F  :  "How  Cities  Differ  in  Their  Magazine-readmg 
Habits  "  S  M,  Feb.  15,  1935.  (Magazine  circulations  per  thousand 
famihe    in  76  'cities  are  discussed  in  this  article.     It  «  be  of 

unusual  interest  and  value  to  all  ^^fZ'V^     \X^li 
:  -The  Factor  of  Age  in  Consumption,"  Market  Research,  September, 

^-Outlook  for  Testing  the  Activities  of  Advertising,"  Management 

Review,  N.  Y.  American  Management  Association,  January,  19*>. 
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Lazrus,  S.  R.:  "How  We  Get  Demand  for  an  Article  Consumers  Buy  Just 
Once,"  P.  L,  June  6,  1929.  (Presents  the  story  of  how  a  certain  firm 
approaches  customers  directly  and  by  means  of  dealer  helps.) 

Leinard,  Augusta:  "How  a  Public  Utility  is  Going  After  Volume,"  S.  M., 
Sept.  13,  1930.  (An  illustration  of  how  a  campaign  was  planned  to 
effect  sales  and  a  research  showing  how  the  answer  was  applied  to 
operating  costs.) 

Lincoln,  E.  E.:  "Sales  and  Orders  as  an  Aid  in  Forecasting,"  H.  B.  R., 
Vol.  V,  October,  1926.  (An  account  of  the  use  of  internal  records  of 
orders  and  sales  plotted  against  general  business  charts  by  Graybar, 
Inc.) 

Lockwood,  R.  B.:  "The  Influence  of  Trends  in  Industrial  Buying,"  P.  I.  M., 
July,  1930.  (While  this  deals  with  the  effect  of  trends  on  products 
for  industrial  use,  it  also  has  significance  to  trends  in  consumer 
buying.) 

Mack,  John:  "Controlling  a  National  Advertising  Campaign,"  P.  I.  M.f 
July,  1930.  (Explaining  a  chart  to  control  advertising  in  32  different 
subjects  placed  in  106  publications.) 

Mann,  Walter:  "Chicago  American  Releases  New  Sales  Control  Study," 
S.  M.,  Dec.  15,  1934. 

Martin,  D.:  "Women  Know  Groceries,"  P.  I.,  Sept.  19,  1935.  (Describ- 
ing two  surveys  in  Cleveland.) 

McMath,  Barton  C,  Jr.:  "How  Newspapers  Serve  Their  Accounts," 
J.  of  R.,  January,  1936.  (123  of  the  leading  newspapers  of  the  country 
have  contributed  to  this  study.) 

Millard,  J.  W.  and  Elsie  M.  Rushmore:  "Marketing  Lessons  of  the  1930 
Census,"  P.  I.  M.,  December,  1930.  (Shows  how  trends  in  methods 
of  distribution  follow  changes  in  the  distribution  of  population.) 

Moore,  Bennett  L.:  "More  Help  Less  Hell  for  Salesmen,"  S.  M.,  Aug.  30, 
1930.      (A  review  of  why  salesmen  fail.     Shows  necessity  for  training.) 

"New  England  Sales  Catechism  Gives  76  Ways  to  Aid  Profits,"  S.  M., 
Sept.  6,  1930.     (Distributed  by  New  England  Counsel  in  six  letters.) 

"New  Fight  for  Outlets;  Competition  for  New  Dealers,"  P.  /.,  Feb.  28,  1935. 

Nilan,  J.  0.:  "Tests  That  Make  Advertising  More  Profitable,"  P.  /.  M., 
May,  1932. 

Nolar,  Marion  K.:  "Interviewing  Important  Business  Executives," 
Market  Research,  July,  1935. 

Philip,  Harriet:  "The  Want  Slip  System,"  J.  of  R.,  April,  1935.  (Ex- 
plains operation  of  the  system  in  twelve  New  York  stores.) 

Phillips,  C.  F.:  "Chain  Store  Mortality,"  Journal  of  Business,  October, 
1934.  (This  article  gives  the  turnover,  closing  and  opening  rates  for 
grocery  chain  stores  in  various  cities.) 

:  "Chain,  Voluntary  Chain  and  Independent  Grocery  Store  Price," 

1930  to  1934,  The  Journal  of  Business,  April,  1935.  (Prices  were 
obtained  from  the  three  types  of  grocery  outlets  and  charts  were  pre- 
pared and  compared  showing  the  difference  in  average  prices.  Both 
branded  and  standard  items  were  considered  in  the  analysis.) 

Reed,  V.  D.:  "The  Price  of  Prejudice,"  P.  /.  M.,  January,  1931.  (A  good 
account  of  various  types  of  prejudice  affecting  the  sale  of  products.) 
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Rice,  James  L.:  "Estimate  of  the  Situation,"  System  (Magazine  of 
Business),  March,  1928.  (Presents  the  army  method  of  treating  a 
problem.     Copied  from  Franklin.) 

Ross  Federal  Service,  Inc.:  "More  Salesmen  Find  Increased  Efficiency 
in  Travel  by  Plane  and  Automobile,"  S.  M.,  Dec.  1,  1934.  (This  is  a 
survey  based  on  interviews  with  many  executives.) 

.  "What  Are  the  Most  Responsive  Markets  for  Food  Products." 

S.  M.,  Jan.  15,  1935. 

Roth,  Richard  L.:  "Price  Zones  of  Misses'  and  Womens'  Dresses/'  /.  of  R., 
July,  1935.  (Presents  a  classification  of  customers  into  district  spend- 
ing groups  as  essential  to  the  scientific  determination  of  price  lines  and 
to  intelligent  efforts  to  increase  the  average  scale.) 

Shafer,  Joseph  E.:  "The  Ford  Stores;  A  New  Departure  in  Retailing/' 
H.  B.  R.,  Vol.  VI,  April,  1928.  (An  Account  of  the  rise,  growth  and 
business  policy  of  the  Ford  commissaries  in  the  Ford  plants  in  Detroit. 
An  example  of  building  a  retail  business  altogether  on  price  and  quality 
and  without  advertising.) 

Smith,,  Donald  B.:  "Planning  Sales  for  a  Manufacturing  Company,  ' 
H.B.  JR., Vol.  V,  January,  1927.     (Explains  method  of  estimating  future 


Smith,  E.  R.:  "Brand  Selection  at  Counter  in  36.9  Per  Cent  of  Sales,"  P.  /., 
Dec.  27,  1934.     (A  factual  study  in  point-of-sales  influence.) 

Smith,  Roy  Lee:  "Home  Grown  Quotas,"  P.  I.  M.,  October,  1930.  (The 
practical  basis  for  a  sales  quota  is  the  cost  of  selling  in  a  particular 
territory.) 

"Springfield  Survey  Shows  Vast  Markets  Still  Undeveloped,"  S.  M.,  July 

15,  1935. 

Staples,  Esther:  "A  «istory  Book  That  Paid  Its  Way,"  A.  S.,  Aug.  20, 
1930.  (An  account  of  the  Dennison  Manufacturing  Company's  way 
of  keeping  tabs  on  its  activities  for  future  reference.) 

Stevens,  W.  H.  S.:  "A  Comparison  of  Special  Discounts  and  Allowances  in 
the  Drug,  Grocery  and  Tobacco  Trades,"  Journal  of  Business,  1934. 
(This  report  is  based  on  an  inquiry  made  by  the  Federal  Trade  Commis- 
sion concerning  actual  selling  prices  from  100  to  300  items  and  includes 
actual  invoice  costs  of  such  items.) 

Stote,  Amos:  "Plotting  the  French  Market,"  A.  &  S.,  Aug.  6,  1930.  (Re- 
views a  survey  of  France  made  by  J.  Walter  Thompson  Company.) 

Stjhr,  Frederick:  "A  Check  List  for  Selecting  a  Product  Designer,"  S.  M., 
Sept.  13,  1930.  '  (A  list  of  questions,  dealing  mostly  with  marketing, 
to  be  answered  satisfactorily  before  a  designer  is  employed.) 

"Testing  Industrial  Designs,"  P.  /.,  May  23,  1935.     (General  discussion.) 

Twentyman,  Thomas:  "Type:  Its  Objectives  and  Simple  Way  to  Achieve, 
/.  of  22.,  January,  1932.     (Describes  ways  of  saving  in  cost  of  resetting 
advertisements.) 

Vaile,  Ronald  S. :  "Trends  in  Objectionable  Advertising,    /.  of  R.,  October, 

Weld,  L.  D.  H.:  "How  Scientific  Can  Copy  Writing  Be?"  A.  &S.,  Nov. 
12,  1930.  (A  suggestion  of  scientific  method  applied  to  writing  copy, 
with  several  interesting  and  instructive  recommendations.) 
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:  "Seasonal  Fluctuations  in  Advertising/'  P.  /.  M.,  August,  1935. 


Wellington,  C.  0.:  "Finding  the  Right  Selling  Price,"  P.  I.  M.,  Decem- 
ber, 1935.  (A  method  for  determining  the  price  at  which  a  product 
can  be  sold  at  maximum  profit.) 

White,  Percival:  "Don't  Plunge  Wildly  on  New  Product;  Test  Your  Mar- 
ket," S.  M.,  Nov.  8,  1930.  (A  plea  that  a  product  be  well  tested  before 
it  is  sold — to  take  the  gamble  out  of  new  products.  Testing  should  be 
with  consumers  and  in  stores.) 

Whitwell,  G.  E.:  "The  Problem  of  the  Unprofitable  Customer,"  Edison 
Electric  Institution,  Bulletin  No.  3,  May,  1935. 

Witherspoon,  J.  J.:  "Budgeting  Territorial  Sales,"  P.  /.  M.,  March,  1930. 
(An  account  of  an  actual  job  of  budgeting  showing  the  amount  of  work 
necessary.) 

Wyman,  W.  F.  and  H.  H.  House:  "Where  to  Sell:  Today's  Problem  of 
Management,"  P.  I.  M.,  October,  1929.  (Stresses  the  need  for  research 
by  management  to  find  the  markets  in  which  sales  should  be  made.) 

Psychological: 

Brown,  Theodore  H.:  "Interpretation  of  Market  Data,"  American  Market- 
ing Journal,  October,  1935. 

Geissinger,  W.  B.:  "Watch  Voluntary  Habits  of  the  People,"  Market 
Research,  July,  1935. 

Hall,  A.  L.:  "Customers'  Conferences  Reveal  Buying  Habits,"  American 
Business-System,  Dartnell  Publishing  Corporation,  New  York,  March, 
1935. 

Kornhauser,  A.  W.,  and  P.  F.  Lazarsfeld:  "Techniques  of  Market 
Research  from  the  Standpoint  of  the  Psychologist,"  Bulletin  of  the 
American  Management  Association,  November,  .4935. 

Laird,  Donald  A.:  "Why  Psychology  Has  Failed  in  Sales,"  P.  /.  M., 
August,  1929. 

:  "How  the  Consumer  Estimates  Quality  by  Subconscious  Sensory 

Impressions,"  Journal  of  Applied  Psychology,  Ohio  State  University, 
Columbus,  June,  1932.  (A  research  by  interview  method  to  determine 
the  effect  of  odor  in  judging  quality  of  a  product.) 

Lazarsfeld,  Paul  F.:  "The  Psychological  Aspect  of  Market  Research," 
H.  B.  R.,  Vol.  XIII,  October,  1934.  (Discussion  of  interpretation  in 
market  research.) 

:  "Art  of  Asking  Why  in  Marketing  Research,"  National  Market- 
ing Review,  Summer,  1935. 

Likert,  Rensis:  "A  Test  for  Measuring  Attitudes,"  Archives  of  Psychology, 
(ed.  R.  S.  Woodworth),  Columbia  University,  New  York,  1933. 

Link,  Henry  C. :  "A  New  Method  of  Testing  Advertising :  The  Psychological 
Brand-barometer,"  Journal  of  Applied  Psychology,  New  York,  1934. 

:  "Psychological  Sales  Barometer,"  A.  &  S.,  Feb.  28,  1935. 

Link,  H.  C,  and  I.  Lorge:  "The  Psychological  Sales  Barometer,"  H.  B.  R., 
Vol.  XIII,  January,  1935. 

Lucas,  D.  B.,  and  C.  E.  Benson:  "Some  Sales  Results  for  Positive  and 
Negative  Advertising,"  Journal  of  Applied  Psychology,  August,  1930. 


BIBLIOGRAPHY  FOR  MARKETING  RESEARCH  421 

(An  account  of  actual  sales  results  from  advertising  containing  positive 
and  negative  appeals  in  sale  of  correspondence  courses,  health  products 

and  books.)  ,    ,  '        ..   ,  D      ,    , 

Phillips  D.  E.:  "Class  Shopping  Experiment,"  Journal  of  Applied  Psychol- 
ogy 'February,  1930.  (An  account  of  shopping  by  120  people  who 
were  on  the  watch  for  certain  things.     A  study  for  owners  of  retail 

stores.)  .       .     _T   ■  ,,  v    R    n 

Poffenberger,  A.  T.:  "The  Unknown  Quantity  in  Marketing,     H.  B.  K., 

Vol   VI,  June,  1928.     (A  discussion  of  human  behavior.) 
"Psychological  Testing  in  Department  Stores,"  J.  of  R,  October    1935. 

(An  analysis  of  returns  from  a  questionnaire  sent  to  more  than  a 

hundred  stores.)  #  #  -.  ■,. 

Wechsler,  David:  "The  Range  of  Human  Capacities,"  Scientific  Monthly, 

July,  1930. 

Sales  Training: 

Bader,  Louis:  "What  Sales  Training  Does  the  Salesman  Want  and  Need?" 
8.  M.,  Jan.  15,  1935.  (A  questionnaire  study  of  more  than  1,000  spe- 
cialty salesmen.)  . 
Iden,  Gilmore:  "Selling  is  Losing  Its  Importance,"  Nation  s  Business 
September,  1930.  (Deals  with  the  declining  importance  of  personal 
salesmanship.)  _  ,  , 
Walters,  R.  G.:  "Does  Business  Want  School  Salesmen?  Journal  of 
Business  Education,  Trathway  Publishing  Company,  Wilkes-Barre, 
August,  1930.  (This  article  presents  a  survey  of  38  corporations  m 
manufacturing  and  jobbing  and  31  retail  stores  to  determine  whether 
or  not  they  favored  teaching  salesmanship  in  schools.) 

.  -Public  Schools  that  Teach  Salesmanship,"  Journal  of  Business 

Education,  September,  1930.  (A  survey  of  125  high  schools  to  deter- 
mine present  status  of  instruction  in  salesmanship.) 

.  *«Vill  Next  Year's  Teachers  Teach  Salesmanship?"     Journal  oj 

Business  Education,  October,  1930.  (A  survey  of  50  leading  commercial 
teacher-training  colleges  to  discover  what  is  being  done  to  tram  teachers 
of  salesmanship.) 

Statistical: 

Cowan,  Donald  R.  G„:  "Sales  Quota  Determination,"  Journal  of  Business, 

July   1935.     (Sales  quotas  discussed  from  a  statistical  standpoint  ) 
Freyd,  Max:  "Two  Types  of  Industrial  Research,"  H   BR.,  Vol.  VI, 

April   1927.     (The  use  of  the  statistical  experimental  methods.) 
Hermann,  Edgar  Paul:  "Figures  Never  Lie-But  Liars  Figure,    P  I  M 

October,  1929.     (Deals  with  many  of  the  errors  and  misrepresentations 

that  are  possible  in  making  charts,  curves  and  graphs.     Shows  how 

these  distort  the  facts.)  a/tot.w«  » 

Sloamanson,  A.  J.:  "Graphs  That  Help  Space  Buyers  Select  Markets 
PI    M     August,   1930.     (Shows  the  use  of  maps  to  explain  more 
readily  statistics  one  needs  to  know  about  markets.     Gives  a  picture 
so  that  one  can  see  at  a  glance.) 
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"Statistics  Can  Be  Made  Interesting,"  P.  /.  M.,  June,  1935.  (A  short 
account  of  the  new  way  to  present  statistics  graphically.) 

Weaver,  Henry  G.:  "Use  of  Statistics  in  the  Study  of  Consumer  Demand," 
Journal  of  American  Statistical  Association,  Vol.  XXX,  March,  1935. 

Weinland  and  Franken:  "The  Age  Factor  in  Advertising,"  P.  I.  M., 
August,  1929.  (An  example  of  the  use  of  statistical  method  of  correla- 
tion to  determine  the  effect  of  age  factor  in  advertising  appeals.) 
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Advertising,     agencies,     conducting 
marketing  research,  9 
data  furnished  by,  102 
role  of,  in  problem  analysis  of 
client,  example,  16ff. 
consumer  indifference  and,  16/. 
instincts  appealed  to  by,  268 
psychological  aspects  of  classifica- 
tion of  example,  202/. 
radio,  data  for,  100 

listener's  reaction  to,  67 
value  of,  interviews,  determining, 
90 
Attributes,    as   psychological  factor 

in  purchasing,  83/. 
Automobiles,  editor's  check  chart  on, 
185 
sales  of,  conclusions  from  study, 
example,  293/ . 

B 

Baking  company,  collection  of  unre- 
corded data,  example,  113,  314 

Beer,  psychological  classification  of, 
example,  198 

Bibliographical  explanation,  27.$". 

Bibliography,  403-422 
statistical,  395 

Brand  barometer,  59 


Census  figures,  use  of,  in  investiga- 
tion, 60 
Chambers  of  commerce,  conducting 

marketing  research,  7 
Charts,    graphic,   in   summation   of 
data,  306/. 
(fiee  also  Questionnaires,  Rec- 
ords) 


Check  chart,  editorial  comments  on, 
185 
for  industrial  marketing,  20-21 
Check  list,  problem  of,  20,  7dff. 
Cigarettes,  questionnaire  for  collec- 
tion of  data  on,  example,  188, 
258#. 
for  machine  tabulation  survey 
of,  260/.,  265 
Classification,  psychological,  of  data, 

190-213 
Clients,  data  furnished  by,  103/. 
Code  sheet,  sample,  186 
Coffee,  collection  of  data  on,  exam- 
ple, 154,  172#. 
Commodities,  statistics  and,  exam- 
ple, 366 
Consumer,  indifference  of,  16 
Costs,  of  investigation,  57-59 
Customers,  character  of,  as  research 
factor,  49/. 
investigation  of,  50jf. 
psychological  aspects  of,  268$". 
sales  and,  in  territory  investiga- 
tion, 4Qfi. 


D 


Data,    collateral,    development    of, 

244/. 
collected,  93-115 

descriptive  approach  to,  273jff. 

hypothetical  approach  to,  268jf. 

list  of  references,  247 

machine  tabulation  of,  248-266 

presentation  of  results  from, 
299-344 

psychological  approach  in  devel- 
opment of  conclusions  from, 
267-281 

report  on,  246/. 
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Data,    collected,  statistical  presen- 
tation of  psychological  results 
from,  273#. 
testing  of,  292#. 
(See  also  Data,  unrecorded) 
collection  of,  organization  of  field 

work  for,  162-177 
consideration  of,  correlative,  289 

direct,  288 
correlations  of,  243/. 
interpretation  of,  243jf.,  283-296 
organization  of,  214-247 
accuracy  in,  233 
analysis,  243^. 
arrangement,  218-243 
chart,  214 

classification,  218-243 
cost  of,  235 
dealers'  characteristics  (example 

chart),  238 
examination,  217/. 
flexibility  in,  233 
graphic  records  in,  241$". 
practicality  of,  218 
reliability  in,  217 
report  on  field  survey,  example, 

219jf. 
reports,  246$". 
sales      possibilities,      example, 

237#. 
selection  for  final  use,  245/. 
speed  in,  233 

statistical  tables  used  in,  quali- 
tative, 236#. 
quantitative,  221  ff. 
psychological  technique  of  classi- 
fication of,  190-213 
recorded,  93-106 

advertising  agencies  furnishing, 

102 
authorities  furnishing,  104 
clients  furnishing,  103/. 
collaborative  sources  for,  106 
collection  of,  chart,  92 
by  group  action,  104-106 
by  individual  action,  93-102 


Data,  recorded,  collection  of,  by 
limited  organization,  102- 
104 

exchange  of,  94 

general  field  researches  furnish- 
ing, 106 

government  furnishing,  97 

institutions  furnishing,  97 ff. 

from  key  sources,  103 

libraries  aiding  in  collection  of, 
95 

magazines  furnishing,  Q&ff. 

multiple-unit  sources  for,  105 

purchasing  of,  94 

for  radio  advertising,  100 

soliciting  of,  94/. 

specialists  furnishing,  104 

statistical  culling  for,  106 

trade  associations  furnishing, 
101 

universities  furnishing,  101/. 
summation  of,  282-344 
types  of,   statistical  analyses  of, 

362 
unrecorded,  108-115 

collateral,  development  of,  244/. 

collection  of,  chart,  108 
field  work  for,  178-189 
by  group  action,  116-148 
by  individual  action,  109-115 
by  organization,  117-177 
by  telephone,  126 
charts,  127,  128,  129 

correlations  of,  243/. 

editing  of,  184jf. 

examples,  130,  131,  134-136, 
138,  140-148,  165,  182,  183, 
188,  227-229,  231,  238,  254, 
255,  257,  258,  260-265 

experimental  studies  in  collec- 
tion of,  115/. 

exploratory  studies  in  collection 
of,  112jf. 

field  personnel  for  collection  of, 
149# 

illustrated  questionnaires  in  col- 
lection of,  121-125, 136, 138 
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Data,  unrecorded,  organization  for 
collection  of,  117jf. 
qualitative,  studies  for  develop- 
ment of,  110/. 
quantitative,  studies  for  devel- 
opment of,  111 
questionnaire  for  collection  of, 

planning,  118j^. 
staff  for  collection  of,  116#. 
statistical  adjustments  of,  244 
(See  also  Data,  collected) 
(See    also  Questionnaire,    Rec- 
ords, Research) 
Dealers,     characteristics     (example 
chart),  238 
interviews  of,  153 
Dry  cleaning,  sample  questionnaire 
for  collection  of  data  for,  144, 
145 


Editing,  of  collected  data,  184jf. 

of  final  reports,  343 
Editors,    instructions    by,    to    field 
workers,  187 

selection  of,  for  investigation,  52 


Freudian  theories  applied  to  market 
research,  268jf. 
example  of  questionnaire  for  col- 
lection of  data  on,  134,  135, 
146 
Fruit  products,  psychological  ques- 
tionnaire in  collection  of  data 
on,  example,  211/. 


G 


Geographical  charts,  in  final  reports, 

330,  339/.  (see  Territory) 
Geographical  data,  importance  of,  in 

marketing  research,  27 
Government,  Federal,  recorded  data 

furnished  by,  97 
Graphic    charts,    in   summation    of 

data,  306/. 
Graphic  presentations,  bibliography 

for,  344 
Graphic  records,  241jf . 
Group  action  and  organization,  104- 

106,  116-148 
Group  research,  104-106,  116-148 

questionnaire  in  organization  of, 
117jf. 


Federal     government,      conducting 

marketing  research,  9 
Field    personnel,    instructions    for, 
(examples),  166-177 
selection  of,  for  data  collection, 

U9ff. 
training  of,  15dff. 
Field  work,  dealers  interviewed  dur- 
ing, 238#. 
inspection  of,  181  J*, 
operation  of,  178-189 
organization  of,  162-177 
routine  of,  162^. 
supervision  of,  180/. 
Food    manufacturer,    collection    of 
unrecorded  data  exemplified  by, 
114 


H 


Housewives,  personal  interviews  of, 
example,  87 


Illustrations,  in  questionnaires,  67, 
121-124 

Industrial  data,  sources  of,  96jf . 

Industrial  markets,  distinctions  be- 
tween consumer  markets  and, 
285/. 

Inferiority  complex,  customer's,  269 

Influences,  as  psychological  factor  in 
purchasing,  83/. 

Inspectors,  selection  of,  for  investi- 
gation, 51/. 
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Instinct,    advertising's    appeal    to, 

268 
Institutions,  recorded  data  furnished 

by,  97/. 
Interpretation,  282-296 
chart,  282 

common  sense  in,  293^. 
correlative,  289^. 
definition  of,  283 
direct,  288/. 

evaluation  of  evidence  by,  quali- 
tative, 288 
quantitative,  287/. 
faulty  judgment  in,  285/f. 
formulating  final  conclusions,  295/. 
general  considerations  regarding, 

283-287 
industrial,  differential,  285/. 
psychological,    of   collected   data, 

267-281 
setting  up  of  tentative  conclusions, 

288#. 
significance  of  data  in,  287 
study  of  quantitative  and  qualita- 
tive interrelation,  291/. 
testing   of  tentative   conclusions, 

292jf. 
weighing  of  data  as  step  in,  287/. 
Interviewer,  attitude  of,  153/. 
conduct  of,  158$. 
instructions  for,  166-177 
sex  of,  152 
Interviews,  of  dealers,  153 

in    determining    value    of    adver- 
tising, 90 
direct,  importance  of  organization 
in,  89 
regarding   popularity    of   prod- 
ucts, examples,  87 
personal,  in  fact  finding,  32 

of  housewives,  example,  87 
social     position     of     interviewee 

influencing,  151/. 
technique  of,  psychological  aspects 

of,  &2ff. 
telephone,  in  data  collection,  126jf. 
charts,  127,  128,  129 


Interviews,    telephone,    facilitating 
discussion   with  social  regis- 
terites,  152 
personnel  for,  149 
(See  also  Investigation) 
Investigations,    aiding   respondent's 
memory  during,  63 
census  figures  used  in,  60 
control  of  sample  in,  53-57 
cost  of,  57-59 

of  customers,  territory  and,  50 
direct,  30^.  (see  Interviews) 

staff  planning  for,  47 
psychological    aspects    of    inter- 
views during,  62-91 
public  records'  use  in,  60 
routine  of,  52/. 
staff  for,  selection  of,  51/. 

training  of,  52 
testing  of  plan  of,  57 
verification  of  field  results  from, 
59 


Laundry,  psychological  aspects  of 
questionnaire,  examples,  204/., 
274/. 

Libraries,    check    of   magazines   in, 
psychological  account  of,  exam- 
ple, 201 
data  obtained  from,  95 


M 


Machine  tabulation,  248-266 
cards  for,  illustrations,  249,  250 
machines  for,  248$". 

illustrations,  251,  252 
mechanical  process  of,  248$". 
operation  of,  250$". 
questionnaire  analyzed  by,  253/f. 
service  bureaus  for,  266 
survey  analysis  sheets,  260^. 
Magazines,    advertising    in,    statis- 
tical data,  examples,  386,  387, 
389,  390,  391 
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Magazines,    check    of,    in   library, 
psychological    account    of    ex- 
ample, 201 
collection  of  unrecorded  data  re- 
garding sales  of,  example,  112 
data  furnished  by,  96#. 
interviews  regarding  popularity  of, 

example,  87 
technical,  readers  interviewed,  ex- 
ample, 72 
Manufacturing  company,  example  of 
faulty    judgment    of    research 
study  by,  301/. 
Market,  data  for  (see  Data) 

determination  of  proper  location 

of,  40#. 
marketing  research  and,  5 
research  sources  of  recorded  data, 

94 
role  of,  in  determining  facts  for 

problem  analysis,  21 
survey  of,  162^. 
Marketing,  industrial,  check  chart, 

22-23 
Marketing  research    (see  Research, 

marketing) 
Milk,     consumption     of     Freudian 
Theory    applied    to    statistical 
data  on,  270/. 
Mood,  of  respondents,  research  data 
influenced  by,  279/. 


N 


Newspaper,  sales  of,  final  report  on, 
sample,  320 
need  of  complete  report  exem- 
plified, 352 
study  of  data  for,  instructions  to 

field  staff,  166#. 
study  of  market  for,  example  of 
faulty  management,  301 


Oil,  psychological  questionnaire  in 
collection  of  data  on,  example, 
206/.      „ 


Organization,  for  collection  of  unre- 
corded data,  117jf. 
of  data  (see  Data,  organization  of) 
of  field  work,  routine  of,  162jf. 
importance    of,    in    direct    inter- 
viewing, 89 


Personnel,  field,  checking  up  on,  182 
inspection  of,  181/. 
instructions  for,  example,  166- 

177 
routine  work  of,  163jf. 
selection  of,  for  data  collection, 

149#. 
supervision  of,  180/. 
tests  for,  178jf. 
training  of,  153jff. 
organization  of,  149-161 
preliminary  test  of,  before  field 

work,  178#. 
school  teachers  aiding  in  selection 
of,  151 
(See  also  Staff) 
Pineapple    products,    sample    ques- 
tionnaire for  collection  of  data 
on,  130,  131,  146 
Policies,    in    determining   facts   for 

problem  analysis,  21 
Product,  marketing  research  and,  5 
role  of,  in  determining  facts  for 

problem  analysis,  21 
type  of,  in  relation  to  territory  and 
sales  force,  40^. 
Psychological  approach  in  develop- 
ment of  conclusions,  267-281 
Psychological  aspects,  of  question- 
naire, 62-91 
response   of   interviewed   persons 

and,  &2ff. 
of  selling  shoes,  examples,  269 
Psychological  classification,  numer- 
ical results  and,  210jf. 
Psychological  implications,  percep- 
tion of,  simultaneous,  276j0". 
in  single  items,  274Jf. 
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Psychological    technique    of    classi- 
fication, 190-213 
(See  also  Psychology) 
Psychology,  of  advertising,  example, 
69 
applied,  267-281 
art  of  asking  questions,  82Jf. 
experimental,  68-69 
as  factor  in  purchasing,  83 
homogeneous  answers  to  question- 
naire assured  by,  79-81 
marketing  research  and,  9,  62-91 
Purchasing,  psychological  factors  in, 
83 


Questionnaire,  ambiguous  questions, 
70/. 

analyzed  by  machine  tabulation, 
253jf. 

answers  anticipated  by,  69-75 

approach  to  topics  in,  78/. 

art  of  asking  questions,  S2ff. 

code  sheet  for  example,  186 

common  sense  in,  294 

comparative  questions  in,  77 

in  determination  of  research  pro- 
cedure, SQff. 

examples  of,  67, 121-125, 130,  131, 
134,  135,  136,  138,  140-148, 
165,  182,  183,  188,  227,  228, 
229,  231,  238,  254,  255,  257, 
258,  260-265 

factors  to  induce  respondents' 
comments,  80/. 

homogeneity  of  answers  from 
psychological  viewpoint,  79- 
81 

illustrated,  67,  121-125,  136,  138 

interpretation  of,  75-79 

leading  questions,  70 

length  of,  49 

mailed,  role  of,  in  fact  finding,  32 

misleading  questions,  70 

in  organized  collection  of  unre- 
corded data,  117jf. 


Questionnaire,  planning  of,  in  group 
research,  117/. 
position  of  question  in,  72/. 
precoded,  for  machine  tabulation, 

259/. 
preparation  of,  130jf. 

samples,  130,  131 
pretesting  of,  89jf. 
psychological   aspects   of,    62-91, 

190#. 
respondent      types      determining 

character  of,  49 
respondent's   age   influencing   an- 
swers to,  79 
routine,  for  field  work,  164^. 
scope  of,  49 
self-selection    of    respondents   to, 

87/. 
specification  of  questions  in,  75/. 
technical  miscellanies  in,  87jf. 
technique  of,  64^. 
testing  of,  89Jf. 
types  of,  137jf. 

(See  also  Data,  Records) 
Questions,  embarrassing,  technique 
of  asking,  65 


R 


Radio  advertising,  data  for,  100 

listeners'  reaction  to,  67 
Radio    broadcasting,    psychological 
study  of  listeners'  likes  and  dis- 
likes, 280/. 
Radio  program,  study  of,  telephone 

questionnaire  for,  129 
Records,  as  aid  to  direct  investiga- 
tion, 30 
graphic,  preparation  of,  241$". 
public,  use  of,  in  investigation,  60 
(See  also  Data,  Questionnaire, 
Research) 
Reporters,  selection  of,  for  investiga- 
tion, 51/. 
(See  also  Personnel,  Staff) 
Reports,  accuracy  of,  353 
bibliography  for,  344-345 
completion  of,  307^*. 


INDEX 


429 


Reports,  final  editing  of,  343 
formulation  of,  307$". 
examples  for,  313/. 
geographical    charts    in,     330, 

339/. 
graphic  charts  in,  323#. 

review  of,  341  jf. 
samples  of,  320,  321 
tables  in,  323jf. 
needs  for  completeness  of,  352 
Research,  extension  of,  understand- 
ing of,  348 
general  field,   data  obtained  by, 

106 
libraries  furnishing  data  for,  95 
marketing  steps  of,  agencies,  6-9 
analysis  of  data  in,  243 
analysis  of  problem  in,  13-33 
determination    of    facts    re- 
quired in,  22-33 
methods,  30-33 
sources  of  information,  24- 
30 
determining      purpose      and 

range  of,  13-22 
immediate  objectives,  15-19 
sales  promotion  and,  15jf. 
scope  of  study  of,  19-22 
ultimate  objectives  in,  14-15 
basis  for  classification  of,  4,  5,  7 
bibliographical         explanation, 

27#. 
bibliography,  403-422 
census  aiding,  60 
character  of  people  to  be  inter- 
viewed in,  49/. 
chart,  2 

collection  of  data  for,  recorded, 
92-106 
unrecorded,  108-116 
(for  details  see  Data) 
cost  of,  57-59 
definition  of,  3 

descriptive  approach  in,  273jf. 
direct  investigation  in,  30^f. 
editing  in,  184jf. 
experimental  psychology  in,  68- 
69 


Research,  marketing  steps  of,  exten- 
sion of,  347-356 
application  of,  347jf. 
emendation  of,  350jf. 

external     factors      influencing, 
27jf. 

field  operation  in,  178-189 

final  report  of,  307#. 

final  selection  of  collected  data, 
245jf. 

Freudian   theories    applied   to, 
268#. 

general  sales  manager's  investi- 
gation during,  42 

geographical  data  and,  27 

graphic  records  in,  241jf. 

by  group  action  and  organiza- 
tion, 104-106,  116-148 

internal  factors  influencing,  24jf. 

interpretation  in,  283-296 

interviews  in,  62jf. 

local  sales  manager's  investiga- 
tion during,  41/. 

machine  tabulation  in,  248-266 

mailed  questionnaires  aiding,  32 

"market"  and,  5 

market  location  determined  by, 

40jf. 

methods  of  study  of,  3-6 

mood  of  respondents  influencing 
data  on,  279/. 

newspaper  advertising  and  cus- 
tomers' response  in,  50/. 

organization  in,  117jf. 

organization  of  field  work  in, 
162-177 

parties  undertaking,  7,  9 
chart,  8 

personal  interviews  in,  32 

practicality  of  findings,  351/. 

predetermining  size  of  sample 
in,  396-402 

present  need  for,  355/. 

presentation    of    results    from, 
299-344 

procedure  of,  basic  considera- 
tions, 44/. 
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Research,  marketing  steps  of,  pro- 
cedure of,  chart,  34 
determination    of    operating 

plans  in,  36$". 
examples,  16^. 
planning  of,  35-61 
questionnaires  in,  36jf. 
sales  promotion  and,  38jf. 
territory      investigation      in, 
40jf. 

practicality  of  findings,  351/. 

problems  determining  necessity 
for,  13 

problems  of,  origin  of,  13 

product  and,  5 

psychological  approach  in  devel- 
opment of  conclusions,  267- 
281 

psychological  classification  of 
data  for,  190-213 

psychological,  hypothetical  ap- 
proach in,  268^". 
procedures  in,  9,  62-91 
statistical  presentation  of  re- 
sults of,  278J. 

public  records  aiding,  60 

publications  relating  to,  3,  4 

purpose  of,  6 

sales  policies  and,  5 

sales  procedure  and,  S9ff. 

scope  of,  3 

selection  of  staff  for  investiga- 
tion, 51/. 

service,  extension  of,  347-356 
application  of,  347jf. 
emendation  of,  350Jf. 

staff  planning  for,  47^". 
time  factor  in,  48 

staff  training  for,  52 

stages  in  operation  of,  4,  5 

statistical  procedure  in,  357-395 

statistical  tables  in,  qualitative, 
236jf. 
quantitative,  227jf. 

stimulation  of  interest  in,  349 

summation  of,  282-344 

supervision  of  sales  force  and, 
41 


Research,  marketing  steps  of,  tele- 
phone used  for  data  collec- 
tion in,  32,  126#. 

time  factor  in  use  of  findings, 
349 

(See  also  Data,  Questionnaire, 
Records) 

understanding  of,  348 

work  sheets  in,  45 


S 


Sales,  possibility  of,  example,  237^". 
procedure  of,  marketing  research 

and,  S9ff. 
territory  affecting,  £0ff. 
Sales  force,  determination  of  details 
regarding,  40jf. 
supervision  of,  41 
Sales   manager,    general,    investiga- 
tion of,  42 
local,  investigation  of,  41/. 
Sales    policies,    marketing    research 

and,  5 
Sales    promotion,    as    objective    in 
problem  analysis,  15jf. 
sources  of  information  in  deter- 
mining    facts     for     problem 
analysis,  24-30 
as  step  in  research  procedure,  SSff. 
Samples,  control  of,  in  investigation, 
53-57 
distribution  of,  55 
predetermining  size  of,  396-402 
size  of,  396-402 

(See  also  Questionnaire,  exam- 
ples of) 
Selling  (see  Sales) 

Service  bureaus,  for  machine  tabu- 
lation, 266 
Shoes,  selling  of,  psychological  as- 
pects of,  examples,  269 
Stabilization  chart,  56 

discussion  of,  54 
Staff,   for  collection  of  unrecorded 
data,  116Jf. 
for  investigation,  routine  of,  52/. 
''sampling"  of,  53jf. 
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Staff,  for  investigation,  training  of, 
52 
planning  of,  47ff. 
selection  of,  for  investigation,  51/. 
(See  also  Personnel) 
Statistical  adjustments,  of  collected 

data,  244 
Statistical  data,  bibliography,  344 

(See  also  Statistics) 
Statistical  presentation,  of  psycho- 
logical results,  273jf. 
Statistical    tables,    compilation    of, 
qualitative,  236#\ 
quantitative,  227^. 
Statistics,  357-395 
analysis  of,  358|f. 
arithmetic  mean  in,  365 
average  and,  363 
data  used  in,  362/. 
bibliography  for,  395 
chain  relatives  in,  387/f. 
correlations  in,  392jf. 
curved-line  trend  in,  382^. 
in   determining   required   size   of 

samples,  397#. 
errors  in,  S59ff. 
probable,  372 
fluctuations  in,  392 
frequency  distribution  in,  372/. 
general  considerations  of,  357^. 
geometric  mean  in,  369 
harmonic  mean  in,  368/. 
measures  of  variation  in,  372 
median  in,  369 
mode  in,  369 

multiple  correlations  in,  359,  392^. 
periodic  cycles  in,  392 
probable  error  in,  372 
seasonal  variations  and,  385jf. 
secular  trend  in,  374 
straight-line  trend  in,  375/f. 
time  series  variations  in,  374 
trend  lines  in  frequency  distribu- 
tions in,  372/. 
various  fluctuations  in,  392 
weighted  average  in,  366 
(See  also  Statistical) 


Summation  of  data,  282-344 
charts,  282,  298 

conferring  with  associates  regard- 
ing, 299#. 
determination  of  form  and  manner 

of  presentation  of,  303^. 
editing  of,  343 
examples  of,  320,  321 
experience  of  advisors  utilized  for, 

302/. 
final  review,  341#\ 
formulation    of    final    report    on, 
307#. 
examples  for,  313/. 
graphic  charts  supporting,  306/., 

323#. 
group  presentation  of,  305/. 
interpretation,  282-296 
personal  presentation  of,  SOSff. 
purposes     of     cooperation     with 

associates,  300$". 
tables  in,  323#. 
Supervisors,  selection  of,  for  investi- 
gation, 51/. 
Survey  analysis  sheets,  for  machine 

tabulation,  260jf. 
Survey  (see  Report,  Summation) 


Tabulations,  in  final  reports,  323#. 
machine  (see  Machine  tabulation) 
in  organization  of  data,  227#. 
Tabulators,  selection  of,  for  investi- 
gation, 52 
Telephone,  data  collection  by,  126Jf. 
charts,  127,  128,  129 
facilitating    interview    of    social 

registerites,  152 
inquiry   by,    staff   planning   for, 

47/. 
interviews  by,  personnel  for,  149 
use  of,  in  fact  finding,  32 
Tendencies,  as  psychological  factor 

in  purchasing,  83/. 
Territory,  as  factor  in  direct  investi- 
gation of  customers,  50 
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Territory,  survey  of,  lQSff. 
(See  also  Geographical) 

Thermometers,  sample  question- 
naires for  collection  of  data  on, 
140,  223 

Tomato  products,  sample  question- 
naire for  collection  of  data  on, 
130,  131 

Toothpaste,  interviews  regarding 
popularity  of,  example,  87 

Topics,  approach  of,  78/. 

Trade  associations,  conducting  mar- 
keting research,  7 
data  furnished  by,  101 


U 

Universities,  data  furnished  by,  101/. 

V 

Vegetable  products,  sample  ques- 
tionnaire for  collection  of  data 
on,  134,  135 

W 

Woodwork  company,  example  of 
problem  analysis  in,  16$". 

Work  sheets,  discussion  of,  45 
(See  also  Questionnaire) 
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